I personally found in my work (long non-programming business-related context, 150k+) that only Gemma 4 31B full precision and full context works reasonably well. MoE Gemma 4, even non–quantised, makes clear logical mistakes or omissions. On real tasks. If I compare them on tiny tests – yes, sure, even i2 quants work great! :-)