Hmm. It looks like natural gas is a little less than $2.50 / GigaJoule (~29.3kWh) at the moment. One A100 eats about 400W, and apparently OpenAI used about 1023 of those running for 34 days to train ChatGPT[1].
There's also a bunch of supporting equipment, so maybe they used around 500W * 1023 * (34*24=816)hrs = 417,384kWh?
I think that would be around $35k in fossil fuels, assuming none of the datacenter's energy came from renewable sources?
There's also a bunch of supporting equipment, so maybe they used around 500W * 1023 * (34*24=816)hrs = 417,384kWh?
I think that would be around $35k in fossil fuels, assuming none of the datacenter's energy came from renewable sources?
[1]: https://www.tooltester.com/en/blog/chatgpt-statistics/