Comment by cfn

It's not launched yet and 2k isn't a hard requirement but faster inference of relatively simple prompts make a big difference for us. Cerebras also failed because it has very small context window.