Comment by kylerush

I assume using this large of a context window instead of RAG would mean the consumption of many orders of magnitude more GPU.