Comment by oezi

GPT-4 might have cost 100m to train, but how much does it cost to run?

If we look at NVIDIAs profits roughly 10x that annual revenue number is spend on hardware from NVIDIA each quarter.