Comment by koayon

And given that the compute is O(n^2) with context window, it's a very real tradeoff, at least in the short term