Although let's see if it is sustainable.
I pay for ChatGPT Plus but most people aren't, and from what I've read they're losing money like crazy. We may wind up seeing this as the technical high point before the various competitors cut back on expensive hardware/energy usage for the free tier, and the quality of the responses takes a dive.
This might sound a bit conspiratorial so apologies for that but back when the competition for Google Assistant/Siri/Cortana/Alexa was super hot, the responses to the various voice assistance was almost eerie in that it could infer what you wanted/needed. Then as things cooled off, they got gradually dumber/worse every year since then. They're legitimately bad today (Siri in particular, but even Google Assistant is much worse than itself from back then). I suspect it is because hardware costs were too high so they found cheaper models that could run on a potato/locally.
From what I've read to get ChatGPT responses in the times it currently takes, they may need to be running something like two 3080 GPUs, 64 GB of RAM, and a high end CPU, with the power draw associated. So to make the economics work (even with ad revenue for example), either a technological breakthrough has to occur to make running today's models much cheaper OR they will cut back making the responses objectively worse (they arguably already did this once with a 3.5 model change).
I pay for ChatGPT Plus but most people aren't, and from what I've read they're losing money like crazy. We may wind up seeing this as the technical high point before the various competitors cut back on expensive hardware/energy usage for the free tier, and the quality of the responses takes a dive.
This might sound a bit conspiratorial so apologies for that but back when the competition for Google Assistant/Siri/Cortana/Alexa was super hot, the responses to the various voice assistance was almost eerie in that it could infer what you wanted/needed. Then as things cooled off, they got gradually dumber/worse every year since then. They're legitimately bad today (Siri in particular, but even Google Assistant is much worse than itself from back then). I suspect it is because hardware costs were too high so they found cheaper models that could run on a potato/locally.
From what I've read to get ChatGPT responses in the times it currently takes, they may need to be running something like two 3080 GPUs, 64 GB of RAM, and a high end CPU, with the power draw associated. So to make the economics work (even with ad revenue for example), either a technological breakthrough has to occur to make running today's models much cheaper OR they will cut back making the responses objectively worse (they arguably already did this once with a 3.5 model change).