Cerebras can do like 4000 tokens per second on gpt oss 120b with it's new chip and around 1000 tokens per second on frontier models using its new chip.
Were you talking about Talaas 8b model? They will probably do something like Bonsai or Qwen 27 B next I hope. But it makes might be an old model.
Were you talking about Talaas 8b model? They will probably do something like Bonsai or Qwen 27 B next I hope. But it makes might be an old model.