Hacker Timesnew | past | comments | ask | show | jobs | submitlogin

Curious how do you run opencode and qwen locally? Few times I tried it responds back with some nonsense. Chat, say, through ollama works well.


Which quants are you using? I had similar issue until I used Unsloth’s. I would recommend at least UD_6. Also, make sure your context length is above 65K.

https://huggingface.co/unsloth/Qwen3.6-35B-A3B-GGUF




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: