jannyfer

I know the paper specifically calls out Opus 5.5 and Opus 5, but I can’t see different versions of Sol, or Astra.

I think the difficulty in comprehension was mostly an Anthropic problem… partly because Anthropic employees stopped reading Opus output around the time Fable came out and stopped noticing RLVR going off the rails with compression.

The paper was a good read, in any case. Maybe I gotta start sending this article back to LLMs when they start compressing text too much :)

> submitted Oct 5 2021

(In case people miss that before discussion)

Wow, 16 PRs?

No wonder GitHub keeps going down.

“When implemented correctly” is probably what people are complaining about.

Opus 5 started adding a bunch of comments to code, even when instructed not to, and for very simple changes where the comment itself was longer than the code change. Was that so that there are enough tokens outputted for watermarking? Many people suspected so.

I believe there are studies about how the environment and who you are with changes your perception of food as well (it was some Radiolab podcast episode I believe). So you will never again have such a great sandwich, even if the exact same sandwich was brought back to you now. But I think it might be good that way - the free flashback and remembrance.

I remember one of my own "best steak ever" moments. It just never hit the same, even though I've had steaks 4x the price since then. I've also had a "best baguette ever" moment and I'm pretty sure it was just a regular baguette but my brain released an incredible amount of dopamine.

On a similar topic - since you said "I always use" - is it true that nearly everyone at Anthropic is using Fable and that's why Opus 5's style of speech was not really noticed as problematic by Anthropic employees?

I agree that the LLM behaviors between Anthropic and OpenAI are different enough now that it can lead to different experiences.

I absolutely hate talking to Opus but don’t mind Sol and Astra.

My guess is Martin used Opus.

A lot of the more sane people I work with have decided that it's futile to try and have stopped working with Opus (we can't use Fable at work due to data retention policies).

RIP. I had frequently used ALT + 0151.

They have a {{currentDateTime}} in the prompt which is interesting for something that gets prefix cached. Hopefully they are handling that properly :)

Interesting, they say "focused, brief, and concise" but not "clear". I find the Claude responses these days are too dense, which contributes to being overwhelming. It's not the number of words used that overwhelm me. I've been asking it to use ASD-STE100 and that helps somewhat.

Hm? I'm saying that the AI firms used to have the philosophy of "ok this kitchen knife is dangerous but we'll catch the murderers" on older AI models. But now, the AI firms think that any average person could send a flying knife to attack a political figure they don't like, from the comfort of their home. Now give this to a billion people, and suddenly you have chaos. So to continue the analogy, now they're mandating drone registration, GPS tracking, etc.

And then a Chinese company sells a drone with no registration or tracking and suddenly people want to turn to legislation to ban Chinese drones.

Hey this analogy is working really well

For a kitchen knife this was okay, but the AI firms think that they’ve built a drone that’s the size of a phone but can fly 100km and can hold a kitchen knife. It might be used to assassinate someone before others can react or even catch them.