streb-lo

Evidence suggests LLMs have internal models as well.

Sure, there are potential risks to anthropomorphizing language. There's also potential benefits, in terms of allowing us to talk about an emerging alien intelligence.

FWIIW, I don't think I was anthropomorphizing. Stretching an analogy, yes. Optimization pressure is producing something with at least characteristics of intelligence. Obviously in a very different way than evolution produced the human brain, but the similarities are there.

Yes, thank-you for informing me I was using an analogy.

We are all stochastic parrots. Currently, millions of years of evolutionary pressure have produced a better algorithm than a few years of optimization pressure but we’ll see how long that remains true!

I think it's more that software is verifiable and RLVR can optimize in the correct direction. Harder to do with prose.

I would guess there is probably a capability ceiling beyond which China will not open source their weights. Maybe there is a scenario where they do so or threaten to do so if the US is so far ahead or something as a deterrent.

>But do we need all this now?

Did people want to make profits from the nuclear arms race? I'm sure some did, but it was not really a requirement.

The bottom line is there is a theoretical capability of AI which is effectively a super weapon that can be deployed against your competitor. If you think that is a possibility, even with a low probability, you should probably have a giant AI-related build if you are the US or China.

None of this actually matters if this is a nuclear weapons-style arms race.

The data center build out will become a matter of national security, and will be backstopped by governments.

Probably because carriers don't want a bunch of poorly secured devices on their networks.

Arch is fine, just don't use the AUR unless you are prepared to validate the PKGBUILD.

Personally, I only use AUR packages that just wrap binaries from well known sources, the only thing that should change in the diff is the sha256 and the version string which makes re-validating them after an update only take a few seconds.

If we're going to do analysis on no information, I would guess you have a lot more "inner turmoil" than the subject.

I think you mean "They're not deterministic, like a meat grinder"

Basically 100% of my interaction with AI is some form of question.

But there are people that treat it like a therapist or a friend.

In my opinion, the 2nd group should be discouraged from using these agents in this way, as it cannot be healthy. But if places like Reddit etc. turn into bot towns where do the AI companies get insight into the general population? Through the eyes of their most mentally unstable users?

So I don't really see things changing, and they'll probably get worse.

It really is not hard to install a Linux operating system manually. "Linux power users" should easily be able to handle bespoke installations.