In context learning, learning via training. Both are things we barely understand the mechanism of.
RAG is a basically a perfect example to understand the limits of in context learning and AI in general. It's faults are easier to understand but the same as any AI vs AGI problem.
I could go on but CL is a massive gap of our knowledge and likely the only thing missing to AGI.
RAG is a basically a perfect example to understand the limits of in context learning and AI in general. It's faults are easier to understand but the same as any AI vs AGI problem.
I could go on but CL is a massive gap of our knowledge and likely the only thing missing to AGI.