laylower
Joined 4 years ago
Joined 4 years ago
You pay for the asset (tenancy in a data center) and then you pay for housing, powering, cooling, etc.
This hits home. It's both a shame and infuriating what's happening in the market right now. One (unsolicited) piece of advice I would give to anyone impacted is to build their own shit. If these companies stop paying for your lunch, then eat their fucking lunch with the same gimmicks they convinced themselves are adequate to stop paying for your lunch.
I'm not just talking about the enterprise giants - build competing products , lower their margins build similar products and offer them for less. Cut out the middle-men. They might have the contract now but their operating costs are higher. In the long run they are uncompetitive.
I figured the experts here would care to express an opinion.
Also, it seems like a RAG on top of an LLM. Is that right?
Now, they're panicking. And this is why the other dude, OpenAI, came out to say that people shouldn't use RAM locally, because they can't control the software anymore.
Open weight models, ablated models are going to become the norm, hopefully, locally run.
So instead, they're saying, look, hardware should become hard to reach for all of us, for the consumers.It's not because we're competing for resources for the same silicon or chips as they are.The ship has sailed thankfully.