Comment by Davidzheng

Big error bars and METR people are saying the longer end of the benchmark are less accurate right now. I think they mean this is a lower bound!