> I'm still trying to wrap my head around how these companies think they are going to do well in this market without more memory.
Cerebras and Groq provide the fastest (by an order of magnitude) inference. This is very useful for certain workflows, which require low-latency feedback: audio chat with LLM, robotics, etc.
Outside that narrow niche, AMD stuff seems to be the only contender to NVIDIA, at the moment.
Cerebras and Groq provide the fastest (by an order of magnitude) inference. This is very useful for certain workflows, which require low-latency feedback: audio chat with LLM, robotics, etc.
Outside that narrow niche, AMD stuff seems to be the only contender to NVIDIA, at the moment.