The elephant in the room here is that the METR report itself was researched and compiled almost entirely by AI, with only very limited human "spot checks."
So I'm really not sure how much of it can be believed, especially since AI agents are strongly biased about the capabilities of AI agents.
So I'm really not sure how much of it can be believed, especially since AI agents are strongly biased about the capabilities of AI agents.