Comment Comment by isoprophlex Tangential to the framework itself, I've been thinking about the following in the past few days:How will the concept of RAG fare in the era of ultra large context windows and sub-quadratic alternatives to attention in transformers?Another 12 months and we might have million+ token context windows at GPT-3.5 pricing.For most use cases, does it even make sense to invest in RAG anymore? parent isoprophlex 2 years ago
How will the concept of RAG fare in the era of ultra large context windows and sub-quadratic alternatives to attention in transformers?
Another 12 months and we might have million+ token context windows at GPT-3.5 pricing.
For most use cases, does it even make sense to invest in RAG anymore?