> Arguably, RAG points to the existence or the beginnings of AGI. The computer can take new information and use it to inform their answer.
I disagree with that. The model isn't fetching information to augment its responses, nor does it have any notion of ground truth or accuracy. I would argue that RAG points at the inverse - we have these incredible probabilistic autocomplete machines but they're so incapable of being reliable that we have to force them to work in a context that we establish for them.
I disagree with that. The model isn't fetching information to augment its responses, nor does it have any notion of ground truth or accuracy. I would argue that RAG points at the inverse - we have these incredible probabilistic autocomplete machines but they're so incapable of being reliable that we have to force them to work in a context that we establish for them.