Hacker Timesnew | past | comments | ask | show | jobs | submitlogin

Who cares about token speed? What is the quality of the results like? I don't know why people are so fixated on token speed, since no one cares how quickly it can spew garbage. Most reasonable people are happier waiting a bit more for accurate results.


It matters on consumer hardware since barely any model runs at reasonable speed.


It also matters for thinking models and for agentic workflows, especially in software engineering, where a lot of tokens need to be output in iterative loops before the user sees any result.

This is our main use case.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: