A quick search say that this is a standard feature you cache the prefill and loa... | Hacker News

Hacker Timesnew | past | comments | ask | show | jobs | submit

pastage 3 months ago | parent | context | favorite | on: I put a datacenter GPU in my gaming PC

A quick search say that this is a standard feature you cache the prefill and load it at PCIe bandwidth so it should be about 0.2s

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact