> They also didn't come up with ChatGPT, arguably the first LLM good enough that can perform non trivial tasks of data recall and organization.
Not only did Google make the main breakthroughs that all LLMs still rely on today (mainly attention architecture, and large scale training of DNNs), but they had a chatbot similar to ChatGPT (Meena [1]) way before ChatGPT was a thing.
Granted: they didn't release it to the public, so there is a failure of innovation there, just not on the technical/machine learning side.
Not only did Google make the main breakthroughs that all LLMs still rely on today (mainly attention architecture, and large scale training of DNNs), but they had a chatbot similar to ChatGPT (Meena [1]) way before ChatGPT was a thing.
Granted: they didn't release it to the public, so there is a failure of innovation there, just not on the technical/machine learning side.
[1] https://ai.googleblog.com/2020/01/towards-conversational-age...