I'm by no means anti-anything but I think what the comments are getting at is that these "world models" do not have a world model. It's a fundamental qualitative gap that no amount of compute has been able to close, just mask by everything else getting better.
This doesn't show up as much where the verifiable reward is "code compiles and tests pass" but you can still absolutely see it in things like movies, prose, or slide decks. Even frontier models are pretty bad at keeping track of narrative threads even as the technical quality drastically improves.
This begs the question of whether the gap can be closed just with more compute (presumably yes, or at least errors can be minimized beyond human capacity to see them) and is that going to be worth it with current tech (possibly no).
This doesn't show up as much where the verifiable reward is "code compiles and tests pass" but you can still absolutely see it in things like movies, prose, or slide decks. Even frontier models are pretty bad at keeping track of narrative threads even as the technical quality drastically improves.
This begs the question of whether the gap can be closed just with more compute (presumably yes, or at least errors can be minimized beyond human capacity to see them) and is that going to be worth it with current tech (possibly no).