I'm working with a lab that has a few Ampere GPUs on infiniband and they are jus... | Hacker News

Hacker Timesnew | past | comments | ask | show | jobs | submit

jimmySixDOF 22 days ago | parent | context | favorite | on: Qwen3.8-Max: A New Bar for Coding and Cowork

I'm working with a lab that has a few Ampere GPUs on infiniband and they are just not compatible with the latest quants and vLLM updates. FP8 is about as low as you can go.

numpad0 21 days ago [–]

But they're reportedly a soft nerfed GA100 64GB/40GB at $1200, that's not more expensive and certainly can't be slower than a Mac Studio.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact