preciousoo
Joined 3 years ago
Karma
434
Submissions
226
Member since
Jan 7
Joined 3 years ago
Uses tmux and gh https://github.com/Kyu/claude-pr-watch
10 groups of 3 researchers, all have their own benchmarks that they do not share (testing it without the authors knowing is a different problem, maybe they only run the benchmarks when the gen-pop has access to the models).
that's 10 different tests. Aggregate pass rates
Neither prompt was enough for llama3.3 or gpt-oss-120b