state_less

Asking the LLM to 'just' fix 'it', or whatever, is going to get you lost in the woods.

You're car will have spun off the road and you'll find it harder and harder to control it and keep it on the road because you have less and less visibility into the vehicle, nor will you be able to clearly see out your windscreen to use the car and road metaphor. You'll be driving blind eventually, unless your working on some simple closed toy problems and/or other small systems.

Building large systems means understanding the system. Without understanding the system, you lose control of it.

The LLM can probably help you understand the system to gain/regain some control of it again, but now you're becoming a system specialist rather than someone who's repeating, "fix it" and "make it good" or whatever.

I don't think the model of highly concentrated data centers makes a lot of sense. From a security standpoint, you can target them easily. It's better for everyone (except perhaps a handful of elite power-mongers) if the hardware is distributed among the populace. I've pushed for something like this before, where each home has a 128GB+ powerful computing rig they can use to run LLMs, generate images and whathaveyou.

I get why the people in power want it, you can concentrate dependence on your asset, do surveillance and industrial espionage. But it's so obviously better to have the power distributed out among the people that it's a no brainer for the average joe/jane.

No doubt, there is still a need for large datacenters to generate models, but we should be looking to a more sustainable/distributed approach when it comes to inference, or running the models. That way people can keep their data, not have their ideas ripped off, not be subject to the whims of whatever policy some technocrat dreams up and not be shit out of luck if someone strikes us-east1 or some such place.

The 4090 I bought in '23 is selling for ~3x what I paid for it now in late '26. There's a huge squeeze going on with computer hardware using relatively cheap borrowed money. Relatively cheap money is flowing into a (artificially?) limited GPU/memory asset class. And this asset class is growing much faster in value than the interest on that money. So if you borrowed heavily to buy GPUs in the prior 3 years, you're likely coming out well ahead even if you are paying 8 to 10% on the money.

That dynamic will fuel further borrowing until we get to some kind of equilibrium, or some kind of washout occurs where interest rates spike higher and/or the value of GPUs and GPU services start leveling off or even declining. We might get a test soon as the FED has started hiking.

It probably doesn't help rates to spike oil prices by starting a(nother) war of choice in the middle east while inflation is already running hot. Eventually you get demand destruction and outstanding debts don't look so good.

I'm glad they gathered the courage to go for orbit and launched these v3 satellites so they can test real deployment of starlink v3. A bit of a cliffhanger for a few moments there. The starlink v3 direct-to-cell coverage will be a big upgrade when it comes online, allowing users without a terminal to use the constellation. And the laser based inter satellite communication is a big upgrade to how v3 can communicate. The catch, landing and recovery of both stages will be big next steps.

SpaceX knows that pulling the risk out of system is the ask here and they continue to progress and push their limits and capabilities, which is a healthy sign for the US space industry and more broadly for technical progress worldwide.

There's something startling about how (relatively) simple these networks are and yet how powerful they are. The main ingredient the AI darlings are using is vast amounts of compute and data. I don't want to take away anything from what the researchers came up with, but I suspect even they are surprised at how capable some of these models have become.

Even before LLMs, ML folks were already aware that you can use a model to teach another model. I doubt this is something AI companies put at the top of their investor materials, but it's been nice to see it play out.

That said, there are other moat factors like, a US company needing to use a US AI provider, sticky customers due to corporate onboarding friction, and others. Not nothing, but not as large a moat as some imagined.

If you read the Influences section just under section you quoted from Wikipedia, it seems she was under the influence of the idea of an 'uncaring universe' from reading Darwin.

And yet there are humans that treat animals well (e.g. dogs, cats, crows and so on... ) These animals would feel the loss if humans disappeared. So i don't think it's right to say that nature (animals) wouldn't care and that the sentiment is a bit of implied put down of animals capacity for emotion and caring. Animals can care about their own and across species. Humanity would do well to feel less disjoint and separate from other humans and animals. That alone would reduce conflict a great amount and highlight the good that can be done between humans and animals.

As you probably noticed, I'm not fond of making a big distinction between humans and animals or nature. Hope that gives another perspective, and yeah, she probably was against the war and upset about the way humans were behaving at the time.

Is that really true? I was under the impression they needed to track the phase of the grid and thus would be able to detect if a fuse is blown or the grid goes down and shut themselves off.

Happy to hear.

I added a ko-fi link to my about page, thanks!

Thanks afro88. I was inspired by the storm in Terence's story, and my time on my sailboat when it felt like the sea was getting to be too much. Glad to share.

I wouldn't know what to tell someone about what entering a (the?) void is like, but the closest i can imagine is a situation where you're 1000 nautical miles out to sea in a small sailboat on a pitch dark cloudy moonless night, far away from anyone. A storm is brewing and the seas are getting large, though you can't see them, it's too dark for your eyes, though you feel the force as it throws your small boat around. It's more than you bargained for, but there isn't anything you can do about it. You're in it now. You're losing control of the boat. You're afraid of what will happen if you lose control, the seas grow larger... The rains and the lightning and thunder are here and it's just too much too bear, so you go down below and lay ahull, surrendering to the sea and forces beyond your control. The sea will make of you what it will, you're fate rests with something larger than yourself. A part of you dies that night, and what emerges the next day is different from what was swallowed by the storm. Your old self at the helm, somewhat unrecognizable. And a part of you never made it out of the storm, remembering that you're always out to sea, and that you needed to come out here to remember that.

I'm pretty sure these large models are run on Nvidia GPUs, not some unobtainable piece of secret kit. You could go down the street and buy from AMD or a number of other vendors to push out FLOPs if you wanted or needed, but you'll need a thick wallet to shell out for a cluster of GPUs to run these models. The reason people don't run the big Chinese models at home is that they can't afford the hardware, not that it isn't publicly available. This tech is essentially a large amount of matrix multiplications afterall.

I think the larger problem is that restricting US AI companies gives the Chinese a leg up because they now have a window open where they can become the source of the most powerful models available due to government restrictions rather than on technical merits. All Anthropic customers just got a downgrade last evening, for example. While the Chinese are able to serve the world or whoever, the US corporations will be limited to the US market, or whatever the powers that be will allow. This restrictiveness could turn out to be disadvantageous to American companies since people will migrate to wherever they can get the most powerful models.