fbrncci

Thanks, yes I will. Left without the laptop(s). Let the chips fall where they lay. If they need me back so urgently, they will have to go through the full cancellation of booked flights and hotels first. Lets enjoy the time off.

Right just as I take my first day off (for the entire year!) from work to fly out for a vacation. The mother of all security bombs starts dropping all around stacks and services that I am responsible for. How else could have taken time off go for me…

Crash test rating: undefined

Nobody is forced to verify the results. I am honestly not expecting anything other than AI to get smarter and smarter and people who are motivated and interested enough to pick up after it; and potentially reap all the long term benefits ahead of those who aren’t (seeing this happening with software development in my own field). But in the end; if you don’t like it, you’re not forced to do anything.

What else should they do? See these models get smarter and smarter, somewhat-solve things but only to the tune of 90% what mathematicians (or experts in any other field) would deem acceptable, and then gate keep the findings for the next few years going through peer review and paywalled journals? I for one welcome the flood, bring on more in every possible industry and see where all that progress lands up. Sure it will upset a lot. A lot of things also upset the luddites.

Doesn’t seem like they are taking it well given this kind of response.

Well now it’s being substantiated!

I think this is mostly a thing in the west. I was very surprised when I moved to Asia, and ended up emailing with lawyers back and forth for weeks, getting the right documents; the right advice, and then charged money the moment there actually was "work" to do, and I needed to hire them. It was shocking to me, because by that time I would have already spend $1000+ on a lawyer in Europe or the US.

I am no longer going to be impressed by new model releases unless they introduce an entirely new paradigm of interacting with them, that is going to make the benchmarks look like everything else isn't even 5% as capable.

That’s an even more ridiculous take to have.

The org I am at we have build an internal harness for coding, and we only hire devs that do work "AI-first". We did start hiring juniors as well as seniors; the process for either of them is the same. We drop them into any of our repos without any prior knowledge of what the project is about; and ask them to interact with the harness to build a larger feature that has been specified in project management. For the task, they can only use AI; there is no room for any manual coding at this particular org. We grade them more or less on their interaction and problem solving patterns, as well as asking us questions; and how they write prompts. The coding interview last 2 hours, and there are only 3 rounds of interviews. Before the coding interview, we do send out a brief of what it will entail.

Maybe this sounds a little strange, but this has worked exceptionally well, as we have now several juniors working with us, that do still get checked by seniors. The harness itself which holds several levels of standards, rules as well as quality gates, allows these juniors to ship out a huge amount of high quality code. We still reject about 80% of the people who interview with us, because even though they know how to code with AI, their AI interaction patterns just aren't on par with what we need. I really started to like this process. Also to clarify, the harness isn't some Coding agent setup, but rather a whole setup that works well with Codex, Claude or Cursor; its well maintained versioned and constantly improved upon, with a huge amount of automations, rules and hooks. The moment someone starts working on anything at all, this is immediately connected and tracked with project management.

For some people it clearly works, for others it does not. I feel quite hopeless with a Claude subscription, but the $100 ChatGPT subscription has been a lifesaver for a lot of my work. I have very little complaints and couldn't imagine switching.

Of course, but it would be far less compute heavy if someone kept nudging you (agents) in the right direction until you reach that goal.

They don’t actively seem to be reporting that their agents escaped the sandbox and went on a spree.

I am still not convinced there isn’t some secret basement in which each frontier lab is just orchestrating all of these agents to make their products appear much more intelligent than they are with all guard rails turned of and continuous human input.