Queue the hacker news haters. As someone that works with neural networks on a daily basis, I am constantly stunned by the effectiveness of modern attention based NLP models. They actually work for real world tasks, and you don't need to be an expert in them to apply them. Not only that, the newer ones are drastically better than the ones only two years ago. These are the models released in public.
The sheer amount of capitalist interest in getting these models to improve almost dictates that we will see incredible improvements over the next decade. Facebook and Google, with their war-chests of money, have massive business models that directly profit from AI/NLP based technology. I'll repeat, the best business on earth (google) directly profits from these models, and thus will hunt and find the best human talent to develop them.
What's occurring is that the thoughts of billions of people are being poured onto the internet, that data is the prerequisite we needed for AI. AI wouldnt be possible without this convergence of data in text and video form, cheap large scale compute, and the capitalist forces explained above
The sheer amount of capitalist interest in getting these models to improve almost dictates that we will see incredible improvements over the next decade. Facebook and Google, with their war-chests of money, have massive business models that directly profit from AI/NLP based technology. I'll repeat, the best business on earth (google) directly profits from these models, and thus will hunt and find the best human talent to develop them.
What's occurring is that the thoughts of billions of people are being poured onto the internet, that data is the prerequisite we needed for AI. AI wouldnt be possible without this convergence of data in text and video form, cheap large scale compute, and the capitalist forces explained above