It is all that. The problem is that there isn’t much of a moat. You can get GPT-3 level performance on a high end laptop and GPT-4 equivalent on high end hardware seems like it’s coming. A lot of advancement is happening in quantization and pruning and training can be done by anyone with access to enough compute.
This is going to just become a ubiquitous tool and part of the computing toolbox. I am increasingly thinking the winner take all dynamics of social media and search may not apply. There’s going to be many cloud hosted AIs and lots you can run yourself if you feel like spending a few thousand dollars on hardware. That cost will fall as more special purpose NPU hardware enters the market and acceleration even becomes a standard part of CPUs.
This is going to just become a ubiquitous tool and part of the computing toolbox. I am increasingly thinking the winner take all dynamics of social media and search may not apply. There’s going to be many cloud hosted AIs and lots you can run yourself if you feel like spending a few thousand dollars on hardware. That cost will fall as more special purpose NPU hardware enters the market and acceleration even becomes a standard part of CPUs.