Hacker Timesnew | past | comments | ask | show | jobs | submitlogin

> Qwen3.5-27b 8-bit quant 20 to 25 tok/sec

It that with some kind of speculative decoding? Or total throughput for parallel requests?



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: