Comment by deegles

Using RAG feels like asking an acquaintance to write a book report by giving them semi-randomly cut out paragraphs from the book.

Finetuning seems to be a solution, but there is still the issue of the LLM not really "learning" facts.

What's the latest on actually adding knowledge to an LLM?