We built a bunch of AI demos but they were impossible to get to production. It would work perfectly on our laptop, but when we deployed it, something broke, and RAG would degrade.
How did RAG degrade when it went to prod? Do you mean your prod server had throughput issues?
How did RAG degrade when it went to prod? Do you mean your prod server had throughput issues?