Comment Comment by p1esk Surely SamA doesn’t actually think that they’ll more than 20x their compute in a few years?If their goal is to train say, a 100T model on the whole youtube dataset they will need 20000x more compute. And that would be my goal if I were him. parent p1esk 1 year ago
If their goal is to train say, a 100T model on the whole youtube dataset they will need 20000x more compute. And that would be my goal if I were him.