Comment by tazo-lezhava

Thanks for the question! Here is an easy tool to compare all the different metrics across LLM judges - https://quissly.com/benchmarks/search/all, but on a high level: Claude Sonnet 5 vs published: 82.2%, kappa 0.745; Claude vs Gemini 2.5: 81.8%, kappa 0.738.

All the details are in the paper as well, of course.