fakebizprez

Wrong.

If a model can run on a 512GB M3 Ultra via MLX or CUDA, but simultaneously benefit from the memory bandwidth of something like an RTX 6000 Pro; that would save my company hundreds of thousands of dollars. That's $20,000 for roughly 600GB of VRAM, and enough token generation speed to fulfill the needs of any enterprise that's not a hyperscaler or neocloud.

I'll let someone else do the math for you on what it costs to put together a 10U server to get that kind of performance without the $10K M3 Ultra Studio.

What we're paying for five old 80GB A100s is criminal, but it's nothing compared to what these GB200 Blackwell setups are going to cost in 2030. Market economics aside, the fact that they require sophisticated liquid cooling infrastructure and draw 3x the power of the A100s, will make these cards unattainable for small to medium organizations.

So yeah, if there's some outside chance that we can pair NVIDIA's speed with a an arm-powered machine that offers 512GB Unified Memory while drawing 50W -- you better believe it's a big deal. We'll see. Sounds too good to be true.

Ceph. The answer is always Ceph.

Dell is one the VCs they raised capital from =(

Hey Michael -- you're a fucking loser.

I've been resisting the desire to go down this rabbit hole because I think it will be the final straw for my girlfriend. Good luck on your quest!

As someone who owns the M3 Ultra Studio, and has been on the iOS 26 Beta since day 1, I will keep this piece of trash off my machine as long as I can.

Brother Tim Cook's days are numbered.

We really are living in the golden age of the terminal. I thought this would take a chunk out of Typescript/node marketshare of young coders, but i'm starting to see more and more of these animals building TUIs using nothing but npm packages.

Have they no shame?

LlamaIndex is batting a thousand since their inception. Can't go wrong with this tool, either.

exactly. there is none.

No, but I actually named my company's flagship software "Laneweaver" (logistics industry) as an homage to what once was a great product.

Adobe will probably read this and sue me.

This x100000000.

I am probably repeating your comment in my sleep, word for word.

Worth every penny.