Hacker Timesnew | past | comments | ask | show | jobs | submitlogin

Sometimes it’s just that a particular backend is poorly optimized or has a regression on a particular platform as compared to the “mainstream” backends. For example, whisper.cpp’s Vulkan backend performs 2-3x worse than CPU on my Snapdragon X2 laptop when using the ggerganov v3 turbo model. It’s probably a simple fix, but it does need to be fixed.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: