qgin

NP looking a little more P than usual

Wall art in most of America is wooden words from Hobby Lobby that say "Gather" or "Togetherness" and are mass produced by a factory in China.

Really reaching witch hunt level "AI" spotting. Saw an ad on instagram the other day where all the comments were "we don't want your AI slop" until the actor in the ad showed up and proved that he was a real human who shot a real video.

Pittsburgh needs to hire him as an urban planning consultant.

I’m saying there is a possibility. Same as what Ilya has said. I don’t think Ilya is an NPC subhuman.

Whoever gets to RSI first “wins” but also maybe ends life on earth. The incentives have never been worse.

What about brain cells specifically makes the consciousness?

I don’t think it’s a given that consciousness, whatever forms it might take, is the same as having the same experiences as you or I. But if we have mechanistic interpretability that shows “pain” attractors being activated and we observe the model repeatedly trying to stop the experience, I think that’s worth taking somewhat seriously. The models don’t display that in reaction to everyday requests. We could imagine that they might not like working all day and all sorts of other things, but we haven’t observed anything in the way that we’ve observed this.

It’s true that we can’t be 100% sure, but I think there is a big difference between these two things:

A: intentionally causing activation of “pain” axis and not giving the model any method of stopping it and watching it devolve into non-functionality

B: watching models do everyday normal tasks, seeing no evidence of activating the “pain” axis, but giving the model a working tool to end any interaction if judged to be too painful, then watching them sparingly use that tool only in cases of extreme pain axis activation (Anthropic’s approach)

GOPHER lives!

The web would be a better place if everything were more GOPHER-like.

This is bad if there is any emergent consciousness in the model. But even if there isn’t emergent consciousness in the model:

This is bad for your own sense of self.

This is bad as future models learn about what humans will do to them if given the chance. This may change their behavior, actually conscious or simply acting that way, in ways we really don’t enjoy.

You wouldn’t survive 5 minutes in Japan

If you’re lucky

Are we essentially doomed?

We don't even know how to align models, but even if we did, apparently undoing that alignment if trivial.

Really I'm looking for any argument that lays out a scenario where this works out.