cagenut

hey little tip while you assimilate and learn the language - property damage is not violence

in many ways, its the very thing that makes us people

I'm just barely starting to wrap my head around mapping model sizes and quants to hardware components and constraints.

I don't get what this device is for.

I a million percent understand wanting 252GB-VRAM, that would get me a 280-320B model like glm-5.3 or deepseek-v4-flash, which would be a massive improvement over my gpt-oss:20b 16GB toy. I would gladly pay a grand for this, I would never pay ten grand for this, and it seems to be priced around a hundred grand.

So obviously the customer is commercial not consumer.

Can anyone planning a project around one of these at work share what their workload is shaped like and how they're modeling price/performance?

For instance, I don't get the 512GB of system memory, I'd gladly drop that to 128 to save money. Am I missing something about commercial workloads? Is a 1T parameter model at 20 tok/s more important to your workload than a 300B one at 60? Is it simply a co-dependency of not the model but the other software you're running on the machine thats using/interacting-with/being-driven-by the model?

Whats your napkin math to justify 100k? Actually thats not even really the question, its more like - whats your napkin math to determine between the "dual linked GB10" use case vs this product's use case vs an 8U supermicro with 4 cards use case.

if its not worth your time to write, its not worth my time to read

this goes 10x for all the slide decks and google docs and wikislop everyone's trying to pass off as an accomplishment lately

I really hate how the excruciatingly overdue reckoning for tech elites and income inequality is turning into this religious schism over AI and datacenters.

We're going to smash the looms rather than figure out how to share them, again.

and flying. beef and flying are the two most impactful personal choices you can make (nearly everything else has a 'over a decade'/difficult-life-tradeoff factor). beef and flying are easy.

the downside is it allows us to continue to avoid solving the real problem

ideologues will tell you this is that all mankind suddenly lost their ability to exert self-discipline a few decades ago

science points to a broad combination of things like corn syrup and seed oils simply making food too addictivly-rewarding and calorie rich for our nervous and endocrine systems to handle.

so, do we reform the farm bill and fast food industries, or do we take the antidote?

there are dozens of us!

similar enough that i'll share, I think i learned this from an HN comment, you can put the code for a page in the url (with obvious limits):

this works as a "url" in both chrome and safari:

  data:text/html, <html contenteditable><head><title>notes</title></head><body><textarea rows=36 cols=140></textarea></body></html>

honestly, look internally. after the plane from qatar. after the son-in-law's real estate dealings. after the visible-to-everyone kalshi and oil futures bets frontrunning the administrations announcements. for you to still feel the need to frame things as "border-line (to be polite)" is, in and of itself, the perfect example of the overall problem.

take your inability to draw a clear-as-day conclusion and state it plainly and multiply it by another ~50M "centrists" who continue to believe that staying "not political" and "avoiding the news" is a viable strategy to just wait the problem out.

until the checked out cowards realize that strategy isn't going to work, things will continue to get worse.

"no politics" might as as well be the second maga slogan.

sorry thats too far left wing an opinion in america today

really? or is it just that you don't like the answer so you keep trying to find another one.

what historical examples of this very common pattern did you read up on?

is there anywhere good to read/follow to get operational clarity on this stuff?

my current system of looking for 1 in 1000 posts on HN or 1 in 100 on r/locallama is tedious.

so is love

this level of reductive thought termination goes nowhere

spacex is one thing but xai accomplished what? the most racist csam prone llm?