ThibWeb

for me it’s more an environmental consideration than financial? Passivhaus Standard for houses is about 50kWh/m²/year, so 30kWh is getting close to 10% of total

(OP) yes all energy / carbon footprint numbers are from Neuralwatt. ty for your work! Switched from Standard to Pro last week, it’s great

Might do more of that next time! Inference was with TensorX and Neuralwatt.

The high usage was due to omp in vibe mode overnight, probably working way too hard through things. The high cost, yes we’d rather pay extra to work with providers that provide other benefits than just lowest cost possible (open models, no training, EU DC, etc)

I agree but it does worry me how fast my usage is increasing. Two months ago I was using 10x less tokens and probably not much more than 5kWh on inference. This month about 30kWh on inference. If it becomes more affordable, is there going to be another jump? Not quite sure

Yep, I think next month will be on that. It feels slightly better from a few days of use, and in our WIP benchmarking it scores way higher

I have a hard time justifying GLM 5.3 these days. It’s slightly better than Flash but rarely enough to justify the much steeper price. We chose to use usage-based billing only so are very sensitive to model price.

Yes, all from Neuralwatt, GPU energy use only. Makes models’ “efficiency” much more visible than tokens.

Hmm I might need to rephrase. Initial challenge was to use GLM 5.3 Flash and I was on the non-Flash version for the whole vibe coded build. Just wasn’t paying attention and I didn’t realize that one session was a quarter of the month’s spend and 150% of the budget (big price difference between models)

It was a bit of a silly challenge, wasn’t sure how workable, learned a lot in the process about what actually drives usage / costs, and how to keep both under control