CEO of Scale said Deepseek is lying and actually has a 50k GPU cluster. He said they lied in the paper because technically they aren't supposed to have them due to export laws.
I feel like this is very likely. They obvious did some great breakthroughs, but I doubt they were able to train on so much less hardware.
I feel like this is very likely. They obvious did some great breakthroughs, but I doubt they were able to train on so much less hardware.