Just use llama.cpp or Unsloth Studio which wraps it, I don't know why anyone use... | Hacker News

Hacker Timesnew | past | comments | ask | show | jobs | submit

satvikpendem 41 days ago | parent | context | favorite | on: Gemma 4 12B: A unified, encoder-free multimodal mo...

Just use llama.cpp or Unsloth Studio which wraps it, I don't know why anyone use Ollama anymore.

verdverm 41 days ago [–]

I switched from llama.cpp to vLLM because of prompt cache bugs in qwen/gemma models

This is a good starting issue with a bunch of linked/related

https://github.com/ggml-org/llama.cpp/issues/22746

Consider applying for YC's Fall 2026 batch! Applications are open till July 27.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact