Hacker Timesnew | past | comments | ask | show | jobs | submitlogin

What's the best way to run this on a 64GB M2 Pro?


Weights are yet to be released (maybe in 24H, Deepseek has track record of releasing same day).

https://github.com/antirez/ds4 is often mentioned for DS4F on Mac, but 64GB is likely not enough to achieve reasonable speeds (official weights should be ~160GB).


DS4Flash has 284B weights. 64GB? No go.


The native weights are 4-bit for the sparse experts, and they quantize to ~80GB with limited degradation in real-world performance. That's a viable target for 64GB with SSD streaming, though it will be slower than keeping the whole thing in RAM (especially on a M2-class machine with its slower storage).


I consider less than 4bit to be too poor quality usually. Got any benchmarks to measure quality?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: