Comment by gtr32x

Using a massive context window is akin to onboarding a new employee before every mundane task performed. While a trained employee will take new task easily with existing context.

The trade off is simply cost. The cost remains in the LLM scene with regards to speed of execution and token cost.