I’m skeptical since we’ve heard the same promises of how chatbots will replace our computer interfaces for years now. The systems always seem to break down when the user needs to do something surprising. Think about trying to navigate an automated phone menu when your option isn’t available.
Transformers seem incredibly good at picking up patterns and repeating them, and combining them in new and surprising ways, but my intuition says that the unpredictability of the real world will cause the required training set to grow faster than the models can keep up, at least to get close to anything that “looks a lot like AGI.”
Transformers seem incredibly good at picking up patterns and repeating them, and combining them in new and surprising ways, but my intuition says that the unpredictability of the real world will cause the required training set to grow faster than the models can keep up, at least to get close to anything that “looks a lot like AGI.”