sabaimran
Joined 4 years ago
Joined 4 years ago
A single AI chat message can consume 0.34 watt-hours of energy (1). So, let's say a hundred messages in an hour (quite an aggressive session) would be 34 watt-hours of energy.
An LCD TV running for an hour consumes about 100 watt-hours of energy, depending on size, LED, vs. OLED etc. (2).
I think AI does help people do better research faster, which is a significant uplift to humanity, while I do not see anyone specifically curbing their TV usage. We should probably focus our effrots on helping people use AI better and meanwhile build more nuclear energy plants, imo.
(1): https://epoch.ai/gradient-updates/how-much-energy-does-chatg...
(2): https://santannaenergyservices.com/how-many-watts-does-a-tv-...
---
And then consider the amount of energy traditionally required by one human to do the same research tasks. Also quite significant.
I think we should be focused on making the more efficient, for sure! But I don't buy that the arguments based on energy consumption are very strong.
Major points of interest for me:
- In the "Main capabilities evaluations" section, the 120b outperform o3-mini and approaches o4 on most evals. 20b model is also decent, passing o3-mini on one of the tasks.
- AIME 2025 is nearly saturated with large CoT
- CBRN threat levels kind of on par with other SOTA open source models. Plus, demonstrated good refusals even after adversarial fine tuning.
- Interesting to me how a lot of the safety benchmarking runs on trust, since methodology can't be published too openly due to counterparty risk.
Model cards with some of my annotations: https://openpaper.ai/paper/share/7137e6a8-b6ff-4293-a3ce-68b...
Whoa, that's really cool.
You can see the paper along with figures & regional breakdowns here: https://openpaper.ai/paper/share/1d0c6956-4820-4ee2-ac1e-12c...
Isn't it very notable that the latency improvement didn't have a performance loss? I'm not super familiar with all the technical aspects, but that seems like it should be one of the main focuses of the paper.
When it comes to things I am not good at at, it has given me the illusion of getting 'up to speed' faster. Perhaps that's a personal ceiling raise?
I think a lot of these upskilling utilities will come down to delivery format. If you use a chat that gives you answers, don't expect to get better at that topic. If you use a tool that forces you to come up with answers yourself and get personalized validation, you might find yourself leveling up.
See: https://arxiv.org/pdf/2305.04388
On a related note, if anyone here is also reading a lot of papers to keep up with AI safety, what tools have been helpful for you? I'm building https://openpaper.ai to help me read papers more effectively without losing accuracy, and looking for more feature tuning. It's also open source :)
Example: Do the problem sets yourself. If you're getting questions wrong, dig deeper with an AI assistant to find gaps in your knowledge. Do NOT let the AI do the problem sets first.
I think it was similar to how we used calculators in school in the 2010s at least. We learned the principles behind the formulae and how to do them manually, before introducing the calculators to abstract the usage of the tools.
I've let that core principle shape some of how we're designing our paper-reading assistant, but still thinking through the UX patterns -- https://openpaper.ai/blog/manifesto.