sothatsit
Joined 5 years ago
Joined 5 years ago
That said, having to do the introduction to programming class at uni despite programming for like a decade in high school was the bigger annoyance.
From https://transluce.org/agent-activity:
> Minutes after Cloudflare blocked the dataset download, an agent sent a reflected cross-site scripting probe to the same dashboard: a web address with code embedded in it, designed to test whether the site would run code supplied by an outsider. Cloudflare's firewall blocked the probe before it reached the dashboard. When Cloudflare blocked the dataset download on AIHW's main site, they fetched the file from AIHW's pre-production server (pp.aihw.gov.au) instead, which served it in pieces over more than 100 scans. The file itself is public, so no non-public data was exposed, but the agent bypassed the site's anti-bot controls.
System One hasn't said how RLCD works, but they do say it is explicitly training models to output "calibrated" probabilities, which makes it distinct from RLVR. This is how they describe it:
> System One models are trained for calibrated decisions: their probabilities are optimized against outcomes to reflect uncertainty.
System One says they use RLCD, Reinforcement Learning for Calibrated Decisions, which presumably has accurate probabilities as an explicit optimisation goal.
I definitely wouldn't put it at 99% of developers, but I'd say it is the norm among developers I know that agents are their primary mode of writing code now (still using IDEs and GitHub to review changes).
The two people I know who don’t use coding agents work in government, and in a data science company working with government.
I’d say if you work at a tech company and agents aren’t writing the majority of your code, that is weird. But if you work at a traditional company that doesn’t have Claude or Codex subscriptions, there it might be pretty normal to still be writing code by hand.
1. Superhuman AI is inevitable.
2. Writing will become a bottleneck to communicate effectively with it.
3. Higher communication bandwidth would let us keep up with the machines.
4. Therefore with higher bandwidth humans could stay part of AI decision processes.
5. That makes it more “human”, as humans would be kept in-the-loop without becoming a bottleneck to be worked around.
6. If you let superintelligence write into your brain, that lets you merge with the machine.
I would also be very shocked if they weren't filtering or prioritising existing pre-training data as well, for example to do curriculum learning or to avoid data that degrades performance.
You could view this as just continually patching a leaky ship. But it seems to work.
That said, Fable is still not a great writer, largely driven by it not knowing what it should exclude, and it still having the usual LLM-isms. But it’s better.