Comment by petergs

This was exactly my question after watching, too. I was assuming not all evaluation runs find it, and they must run a huge amount of runs. If these are all cybersecurity evaluation runs, it's actually not too crazy to imagine that many individual agents (with the same weights and training) would (1) try to look for solutions via the internet once they're stuck (2) realize they can't reach the internet (3) basically start doing reconnaissance and network scanning in an attempt to get internet access (4) discover that the only thing they can communicate with is artifactory. Pivoting like this is exactly what a human attacker would do, too.