choilive
Joined 6 years ago
Karma
750
Submissions
317
Member since
Oct 10
Joined 6 years ago
Is it all one big computation? Its turtles all the way down.
Getting the compute to run inference for multi-trillion parameter models at any sort of scale and performance is daunting. There are a handful of vendors that have systems that can do this (~ Nvidia NVl-72 class) that pretty much only the frontier labs and hyperscalers effectively have access to.