9wzYQbTYsAIc

Joined 11 years ago

Karma
1,882
Submissions
1,155
Member since
Aug 3
Byzantine Fault Tolerance
View on Hacker News

Recent submissions

Comment · 5 months ago
Next thing to go will be loops and scheduled tasks, if they keep needing to trim usage to fit in the available compute, I suspect, if ‘claude -p’ is essentially gone, now.
Comment · 5 months ago
Or start switching to open-weights, local LLMs for basic development. Would rather invest in my own hardware than Anthropic’s, tbh.
Comment · 5 months ago
Exactly, the weekly limits are the real limiting factor. If you really push it, you can easily hit the weekly $200/mo Max limit in a day.
Comment · 6 months ago
Have any ins? ;)
Comment · 7 months ago
If you think in terms of quantum mechanics and density matrices across higher dimensions, then, yes there are interesting geometries that arise.

I’m exploring some “branes” that might cleanly filter in emotional space.

Comment · 7 months ago
Comment · 7 months ago
Consciousness: do you believe plants are conscious? Ants? Jellyfish? Rabbits? Wolves? Monkeys? Humans?

Even fungi demonstrate “different communication behaviors when under resource constraint”, for example.

What we anthropomorphize is one thing, but demonstrable patterns of behavior are another.

Comment · 7 months ago
Comment · 7 months ago
Pretty easy to test, I’d imagine, on a local LLM that exposes internals.

I’d suspect that the signals for enjoyment being injected in would lead towards not necessarily better but “different” solutions.

Right now I’m thinking of it in terms of increasing the chances that the LLM will decide to invest further effort in any given task.

Performance enhancement through emotional steering definitely seems in the cards, but it might show up mostly through reducing emotionally-induced error categories rather than generic “higher benchmark performance”.

If someone came along and pissed you off while you were working, you’d react differently than if someone came along and encouraged you while you were working, right?

Comment · 7 months ago
It might simply reduce down to a big batch of sliders and filters no different than a fancy audio equalizer: Anthropic was operating on neurons in bulk using steering vectors, essentially, as I understand it.
Comment · 7 months ago
Hah, I have been thinking about trying to study LLM psychology, nice to see that Anthropic is taking it seriously, because the mathematical psychology tools that can be invented here are going to be stunning, I suspect.

Imagine coding up a brand new type of filter that is driven by computational psychology and validated interventions, etc

Comment · 7 months ago
> Force-set to 0, "mask"/deactivate those representations associated with bad/dangerous emotions. Neural Prozac/lobotomy so to speak.

More complex than that, but more capable than you might imagine: I’ve been looking into emotion space in LLMs a little and it appears we might be able to cleanly do “emotional surgery” on LLM by way of steering with emotional geometries

Comment · 7 months ago
They already can, but, only if you really invested in a performant computer in last few years. If you really invested 10 years ago, you might also get lucky, but that RTX and high VRAM will be key.

Oh, or you could also use a Mac or recent iPhone, they do fine too, today.

Tomorrow is only speculation, but it looks promising, with all the new optimizations and realizations that LLMs aren’t the king of the hill, they are an option on a spectrum of choices.

Optimized small models might surprise you.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton