GPU's in cloud is just a bad business unfortunately.
There is only one vendor (for anything scientific/ML anyway) and you have to buy specific (overpriced) models from them to be compliant with the license. So zero negotiating power, and everything is proprietary so you cant build any software/support edge.
You cant oversell a GPU like you can CPU/memory, and most of the computation happens on the chip so no one cares how good the rest of your stack is.
And finally you are in a neverending battle with crypto miners, which would never be profitable on cloud so they have no intention of paying you.
There is only one vendor (for anything scientific/ML anyway) and you have to buy specific (overpriced) models from them to be compliant with the license. So zero negotiating power, and everything is proprietary so you cant build any software/support edge.
You cant oversell a GPU like you can CPU/memory, and most of the computation happens on the chip so no one cares how good the rest of your stack is.
And finally you are in a neverending battle with crypto miners, which would never be profitable on cloud so they have no intention of paying you.