Comment by ex-aws-dude

I don't know much about LLMs but does that mean you have N^2 computation with the context size since every token needs to track how it relates to every other token?