Comment by shelfchair

I don't think this is relevant on AA's FrontierCode score. AA runs FrontierCode 2.0 benchmark using their own Stirrup agent harness [1].

[1] https://artificialanalysis.ai/evaluations/frontiercode-2-0