You are fundamentally misinterpreting this paper. If this should hold up in review, it contains multiple capabilities that no human and no technology so far (especially not ROME) can do.
Experiments 1, 2, 3, 5 and 6. All of these are technical breakthroughs
Weight space programming is a holy grail of RSI research, and what you are talking about is very different from that, while the paper's proposals are exactly that.
It's similar in spirit to the Navier Stokes solution in that this level of LLM can intuitively navigate extremely large search spaces, rather than inefficiently bruteforce something
Experiments 1, 2, 3, 5 and 6. All of these are technical breakthroughs
Weight space programming is a holy grail of RSI research, and what you are talking about is very different from that, while the paper's proposals are exactly that.
It's similar in spirit to the Navier Stokes solution in that this level of LLM can intuitively navigate extremely large search spaces, rather than inefficiently bruteforce something