Comment Comment by dzonga 80-90% of AI costs are related to inference. Once zAI served their new model entirely on Chinese chips for free then the nVidia jig is up.who is going to pay back the money nVidia invests in AI labs, AI datacenter companies if the models are being served dirt cheap.the Chinese are not the only competitor - Amazon with their Trainium, Google with their TPUs etc.Nvidia might have a moat on training but on serving it's gonna be a blood bath.But for now they're capturing 80% of all the AI spend so they gonna keep making money. parent dzonga 1 month ago
who is going to pay back the money nVidia invests in AI labs, AI datacenter companies if the models are being served dirt cheap.
the Chinese are not the only competitor - Amazon with their Trainium, Google with their TPUs etc.
Nvidia might have a moat on training but on serving it's gonna be a blood bath.
But for now they're capturing 80% of all the AI spend so they gonna keep making money.