> This means it is way cheaper to look something up in a vector store than to ask an LLM to generate it. E.g. “What is the capital of Delaware?” when looked up in an neural information retrieval system costs about 5x4 less than if you asked GPT-3.5-Turbo. The cost difference compared to GPT-4 is a whopping 250x!
In a narrow use-case of a strict look-up. This seems to exaggerate the cost difference while having completely different trade-offs.
In a narrow use-case of a strict look-up. This seems to exaggerate the cost difference while having completely different trade-offs.