rmast
Joined 10 years ago
Joined 10 years ago
Ripping off the metaphor for a moment, it was basically extending what you said to point out that being a coder and using LLMs aren’t mutually exclusive.
(Asking them to reserve erm akshully’s for someone else came across as rather dismissive sounding of their thoughts, which from a former bystander in this thread appeared legitimate and just a continuation of using your own metaphor).
Basically, the moat for many products is disappearing, and it would be relatively cheap for someone to make a clone that undercuts the cost of the first to market. The original product is charging $2? Cool, the clone will cost $1 - maybe it’s not as good due to less QA, but consumers will see the lower price and buy it.
Maybe Fable can do the same things better than other models, but having to tiptoe around to avoid tripping safeguards makes GPT 5.6 so much easier to work with that I don’t even bother with Fable (or Opus 5) now.
To be honest though, I don’t know what happens when something gets banned from Codeberg, or anything about the appeals process, so my brain leap to the project just disappears forever; afaik the posts I read about this policy change didn’t say. Would welcome anyone familiar with their policies to chime in and enlighten me.
Then I did some searching and found multiple examples of both definitions in use, making things murky.
So I turned to Merriam-Webster’s dictionary: “ of, relating to, or being a vulnerability (as in a computer or computer system) that is discovered and exploited (as by cybercriminals) before it is known to or addressed by the maker or vendor”
And of course they use an “or” to make it ambiguous as to whether the days start counting when the vulnerability becomes known, or when the vendor has addressed it.
For generating the initial 3D simulated safe using three.js it worked well, but then modifications to print a flag tripped the safeguards; eventually got it narrowed down the part in the prompt about it being for a CTF for students, and the "thinking" for the model seems to drift to ideas of encryption/obfuscation of the safe combo so students can't just read out the answer... which makes sense logically to help force students into turning the simulated dial instead. But whatever detection Anthropic I guess just naively sees the model thinking about "encryption" and "obfuscation" without taking into account any of the context.
For writing the dummy firmware, it tripped the safeguards while thinking about how to track dial position in the firmware and output the message; however, when I left out talk about safes and just told it to write firmware for a microcontroller hooked up to an i2c display for showing a message with a beam break sensor to determine the message, and an unspecified i2c chip for getting an unspecified number (e.g. internal wheel positions) it worked fine.
An unrelated software task I asked it to write some code to translate CustomActions in a Windows MSI installer into human readable stuff, which has (exclusively?) defensive security applications for recognizing malicious behavior in an MSI installer. Maybe I'm going crazy, but I'm guessing as part of its research into MSI installer custom actions Fable found articles about analyzing malicious MSI installers, and that probably tripped the safeguards.
Overall my impression is that the safeguards are perhaps using an overzealous and naive implementation that just looks for a list of banned words in the prompt or the thinking -- which drives me crazy when the model says my prompt looks fine, and then 10 minutes in some part of the thinking trips the safeguard.
I’ve been surprised how easy it can be to get Python and C# code running in a browser.