i wouldn't trust the small llm there. it will be an intellectual bottleneck when... | Hacker News

Hacker Timesnew | past | comments | ask | show | jobs | submit

chimpanzee2 56 days ago | parent | context | favorite | on: Pruning RAG context down to what the answer actual...

i wouldn't trust the small llm there.

it will be an intellectual bottleneck when it comes to processing the very information your just arduously fished out of the ocean!!

kordlessagain 56 days ago [–]

I've had good success using a local model for preprocessing (tag extraction) and tuning the search parameters (hybrid search).

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact