Comment by jasonjmcghee

> GPT-4 boasts 100 trillion parameters

Source? I’ve never heard this.

I’ve heard 1 trillion and that it’s a 8 x 175B ensemble.