DeepSeek drops CUDA kernels for fast inference, if users care about having day-0 fast inference, you'll have to play catch up every time.
Also, I've heard many western labs use open source CUDA kernels (usually from Chinese labs), IMO it makes little sense to move away from CUDA right now unless you're a big player that can afford a patchy ecosystem with internal development (e.g. Anthropic with JAX/TPU).
Also, I've heard many western labs use open source CUDA kernels (usually from Chinese labs), IMO it makes little sense to move away from CUDA right now unless you're a big player that can afford a patchy ecosystem with internal development (e.g. Anthropic with JAX/TPU).