Comment by changoplatanero

Anyone can make a long context window. The key is if your model can make effective use of it or not.