It’s just corporate profits combined with market forces, not a some sort of malicious conspiracy.
You can rent a 2-socket AMD server with 120 available cores and RDMA for something like 50c to $2 per hour. That’s just barely above the cost of the electricity and cooling!
What do you want, free compute just handed to you out of the goodness of their hearts?
There is incredible demand for high-end GPUs right now, and market prices reflect that.
Azure's HB120rs_v3 size is about 36c per hour right now with Spot pricing in East US. These use 3rd generation AMD EPYC "Milan" processors.
The instances with the 4th generation "Genoa-X" processors (HB176rs_v4) cost about $2.88 per hour. The HX176rs_v4 model with 1.7 TB of memory is $3.46 per hour.
Are these actually attainable, as in I can log in and launch an instances with these specifications right now, or are they just listings? I ask because literally last week I was unable to launch similar instances on AWS despite those specs being listed as available and online.
You can rent a 2-socket AMD server with 120 available cores and RDMA for something like 50c to $2 per hour. That’s just barely above the cost of the electricity and cooling!
What do you want, free compute just handed to you out of the goodness of their hearts?
There is incredible demand for high-end GPUs right now, and market prices reflect that.