Comment by kartikarti

For those interested in crazy inference speeds, check out Groq.

(I’m not affiliated in any way.)