Comment by WarmWash

The way it is right now is to build giga-monster models, use those internally to boost yourself, and distill them down into lighter consumer models.

Apparently OAI is already building GPT7 and GPT8