Hacker Timesnew | past | comments | ask | show | jobs | submitlogin

What is your config for getting 80tps decode?
 help



Qwen 3.8 27b Q4_K_M w/ matching dflash drafter, 256k context, llama.cpp+dflash2, draft-n-max=5

Also using with Charmbracelet Crush with Froggerinc fixed chat templates.


Thank you! Have to look into it.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: