Hacker Times
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
AussieWog93
43 days ago
|
parent
|
context
|
favorite
| on:
Performance per dollar is getting faster and cheap...
The 2600 tok/s is an "aggregate", not the actual throughput.
technoabsurdist
43 days ago
[–]
yes it is 213 tok/s single stream (so per user)
unrvl22
43 days ago
|
parent
|
next
[–]
that 213 wasn't achieved when saturated though. was probably more like 30 tps per stream when doing 2.6k tps.
3836293648
43 days ago
|
parent
|
prev
[–]
So per subagent*.
alienbaby
43 days ago
|
root
|
parent
[–]
*per stream, I guess is more accurate than either?
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
