>Still, we are looking at GPT3 level of performance on one server rack. That says something when less than a year ago, such AI was literally magic and only run on a massive datacenter.
I'm not sure what you mean by this. You've always been able to run GPT3 on a single server (your typical 8xA100).
I'm not sure what you mean by this. You've always been able to run GPT3 on a single server (your typical 8xA100).