Comment by LarsDu88

I think 300 tps might be roughly what an astra sized model would be at if running on Cerebras hardware no?

Or are they simply lower the batch sizes on whatever hardware they are currently running?