Comment

Comment by fastball

No, Cerebras is serving GPT-5.6-Sol (released in July).

OpenAI is back to using Nvidia chips (with small batch sizes) for the ultrafast mode of their latest models.

That takes the speed down from from 750tok/s on Cerebras to 300tok/s, and presumably is much more expensive than the Cerebras solution, but Cerebras has supply constraints. I believe they are planning aggressive data center expansion in this quarter but much harder to scale up than Nvidia chips.

parent fastball 6 days ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton