wish I had a rtx5090 instead of the rtx4090 so I can run this, need 32GB VRAM I assume, no I use Linux and I do not enjoy MacOS, I wish x86 family has something like M5 Pro though.
I was just wishing I had 24gb rather than 16gb so I could run q4 comfortably. Unsloth q4 variants are 15.4gb-17.6gb so it seems at least well worth trying on a 4090.
