typon

Couldn't happen to a better bunch of people.

I used to think that Oxide's business model sucks in the face of the hyperscalers. When AWS/GCP/Azure "just works" and is generally reliable and cheap, why would I go through the trouble of buying my own computers? Well the past 5 years have been a constant decline towards more concentration of power, lack of care for their customers, and degradation in quality in general. AI is of course accelerating this decline - selling de-slopped products is now a huge competitive advantage. All the best luck to Oxide.

I am using a model that runs on a 100 GB300s, near AGI, all bets are off, $10B training run on a 1GW cluster, and it can't realize that when I told it to "please implement v2 of feature X" that I mean delete v1, not support v1 and v2 together, in a weird Frankenstein's monster of the two. Sorry, but I think my job is quite secure for the forseeable future.

If there really was a "simple" solution to Fermat's Last Theorem, Andrew Wiles wouldn't have achieved the important result he did, ending up making connections across disparate fields of math.

The LLMs "sweeping up" easy, or previously missed, results seems like a net negative. It's probably better for humans to struggle and come up with new tools than to just "clean up" low hanging fruit that doesn't add much value to the field.

Yes that's called Mythos 2 or GPT 6

There is ton of room for improvement "down there".

* Software inference optimizations

* Heavy quantization

* Chips with hardcoded transformer architecture

* Much cheaper HBM

* Much sparser models - 1T total with ~1-10B active params e.g.

* Not to mention - 2 years of today's frontier models writing RTL and kernels at superhuman levels.

By early 2028, major players like Intel, AMD, QC will ship accelerators in consumer laptops capable of running ~1T MoE models at ~100 tok/s

I remember saving up for a year to buy the ATI Radeon 9600 XT (I think it was $200 MSRP) so I could play the game on high settings. Now we can play it inside a virtual machine on a crappy laptop. What a journey

Always pains me to see all this innovation and cool software work being applies towards making a machine that extracts money from retail investors and makes a few people extremely wealthy. What a depressing and colossal waste of time.

Actually I think AI will largely automate software and math and really not much else in the short to medium term. (speaking as a computer/math person)

Next time there is a fire at your house I will say "he's an adult who should have been careful playing with dangerous things like fire, we shouldnt waste society's money and resources on saving his house"

That part should be non negotiable - the tech companies should be funding the energy infrastructure. My bet is that they'd happily do it. They are starved for space and energy, not capital.

Can someone explain to me why local governments are so against datacenters? It seems like a golden opportunity to build electric infrastructure that's paid for by corporations and if AI is a bubble at least that infrastructure will remain and continue to provide cheap power.