Hacker Times
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
ricardobayes
40 days ago
|
parent
|
context
|
favorite
| on:
Gemma 4 12B: A unified, encoder-free multimodal mo...
You can run it, however those low quantized models (iQ2, iQ4, Q2) will very likely underperform the 9B versions at Q6/Q8.
kanemcgrath
40 days ago
[–]
Something about qwen models hold up really well even at low quants. for most other models anything under q5 is cooked, but on 35B-A3B I can get a lot of things done even at q3_xl. It is definitely better than full precision 9B
Consider applying for YC's Fall 2026 batch!
Applications
are open till July 27.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
