I've had this experience with RAG systems as well, but I've been wondering if structuring unstructured text (like a novel) in the form of a knowledge graph may solve this problem.
Perhaps coupling a vector embedding search with a knowledge graph created from unstructured text could lead to more informed answers from LLMs?
Perhaps coupling a vector embedding search with a knowledge graph created from unstructured text could lead to more informed answers from LLMs?
It seems as though some companies and researchers are already experimenting with this idea: https://www.nebula-graph.io/posts/graph-RAG.