Just out of curiosity, I wish online LLMs would show real-time power usage and actual dollar costs as you interact with it. It would be so insightful to understand to which degree the technology is subsidized and what the actual value/cost ratio is.
I've read somewhere that generating a single AI image draws as much power as a full smartphone charge.
In case the suspicion is true that costs are too high to be monetized, then the current scale-up phase is going to be interesting. Right now people infrequently have a chat with AI. That's quite a different scenario from having it integrated across every stack and it constantly being used in the background, by billions of people.
Late as they may be, for the consumer space I think Apple is clever to push as much as possible to the local device.
I've read somewhere that generating a single AI image draws as much power as a full smartphone charge.
In case the suspicion is true that costs are too high to be monetized, then the current scale-up phase is going to be interesting. Right now people infrequently have a chat with AI. That's quite a different scenario from having it integrated across every stack and it constantly being used in the background, by billions of people.
Late as they may be, for the consumer space I think Apple is clever to push as much as possible to the local device.