Comment by watwut

The benchmark has unsolvable tasks in it, in the hope agents will stumble on new solutions.

Yes, it is a tool.