Comment by bradhilton

I know Google DeepMind ran experiments with 10M a while ago, but I think this will be the first legit, released 10M context window model.