> Deepseeks secret sauce is the incredibly cheap caching (magnitude cheaper than other providers).
Can anyone working at one of the main US labs (Google, OpenAI, Anthropic) comment on WTF they haven't even tried MLA - despite the obvious massive advantages?
I know enough to know they aren't completely incompetent. So there must be a quite good reason.
But it remains a mystery to me.
DeepSeek's MLA is like almost 2 years old at this time. They've got thousands of people working on this stuff. They clearly have the ability to at least try it...
Can anyone working at one of the main US labs (Google, OpenAI, Anthropic) comment on WTF they haven't even tried MLA - despite the obvious massive advantages?
I know enough to know they aren't completely incompetent. So there must be a quite good reason.
But it remains a mystery to me.
DeepSeek's MLA is like almost 2 years old at this time. They've got thousands of people working on this stuff. They clearly have the ability to at least try it...