fxtentacle

I’m hoping that someone will tackle Garmin entirely by releasing open source replacement devices ..

... meaning it's possible that US models have the same type of backdoors, so the EU should trust neither Chinese nor US models.

"What is this superpower, and why is nobody else using it?"

The "Undo" time-travelling debugger for C/C++ has been around for 20+ years. So I guess the answer is simply that most people chase shiny new things instead of using established, reliable, and, hence, boring tools.

Fully agree.

Since even Fable 5.1 cannot reliably remember what it wrote into "memory" files before the last compaction, why would we trust it to not forget about some side-effect when handling assembly that is so verbose it'll surely exceed the context and, hence, necessitate compaction.

I'd say you're fully off the mark here. That page contains serious architectural insight on how to make a "designed" car feeling work within a "physically correct" collision engine. Getting the balance right is super hard and he explains how to do it. I'm confident no AI could do that architecture, so this is most likely hours of hard work with a thin layer of LLM gloss on top.

Hi there, I have some experience with reinforcement learning, PPO, RLVR, and I trained both video game AIs and sim2real robot policies.

In my experience, videos from professionals are not enough to train a robot, because you lack all/most of the edge and failure cases. Let me illustrate with pilots: The average Airbus can land itself via autopilot. Autopilot will fly it to the correct location. You confirm the frequencies, it connects to the airport's guidance system and lands itself. Super boring. Videos of that won't help anyone become a proper pilot. The reason pilots train for years is to handle the 1 in a 1000 case where the autopilot doesn't work. And you suddenly have to take over in the middle of a messy approach.

Translated back to your plumbers, the real training is when the robot is carrying a 100kg metal pipe and then the owner's kids come running and pass through under it. Every professional will give their best to immediately reduce efficiency by making things stationary and SAFE. That's the training data that is truly valuable.

BTW, I am considering bootstrapping a startup that uses video game engines to generate training data to make robot policies anticipate physical effects and counter-steer before they happen. Like putting down a heavy steel pipe before it drops due to gravity. With 2 bugfixes merged into the Unreal Engine, I have some experience there ;) So I might soon be in the business of selling custom training data.

Feel free to email me at hn at hajo me

... brought to you by storyteller.ai, which now has a defunct hero video, but apparently still 10 mio users (at $12+ monthly). I very much applaud them for pouring their (est.) $1.4B ARR into Open Source.

Deterministic feedback is precisely how frontier models are trained. It’s called RLVR. You let the agent run on a problem and then calculate a deterministic score of how well it did. Repeat 1000x times and you can “brute force” a good solution. (Which includes all thinking traces and you add it to your training data.) And then a Chinese model can copy your advance for 1000x less compute. Which is why US labs call this not learning, but a distillation “attack”. It’s an attack on the business model.

Probably the code of these games leaked in some dark corner of the web in the past and that’s why AI can generate it so nicely. AI is also extremely good at building Quake 3, including Carmack’s notes.

But as soon as you are just a tiny bit off the beaten path, Fable/Sol will go postal regularly. So if your indie game has interesting gameplay mechanics, nobody will be able to 1-shot that for a long time. (Because their prompt would have to include everything that’s unique to your game.)

This is fundamentally about price. Does every service use EC2? No! Because at certain scales, the absolute price differences become too large. And then you celebrate the millions in additional profit generated by moving from EC2 to bare metal. It’ll be the same with SaaS: those companies keeping things AI-free will have higher profit margins. So the market will reward AI-free.

if he “had been made aware that OpenAI has scraped and trained on information that was behind a paywall,” the company would have required OpenAI “to retrain its models.”

... yeah, sure.