Comment Comment by gyrovagueGeist Electricity (on continental US) is pretty cheap assuming you already have the hardware:Running at a full load of 1000W for every second of the year, for a model that produces 100 tps at 16 cents per kWh, is $1200 USD.The same amount of tokens would cost at least $3,150 USD on current Claude Haiku 3.5 pricing. parent gyrovagueGeist 6 months ago
Running at a full load of 1000W for every second of the year, for a model that produces 100 tps at 16 cents per kWh, is $1200 USD.
The same amount of tokens would cost at least $3,150 USD on current Claude Haiku 3.5 pricing.