bdlowery
Joined 4 years ago
Karma
380
Submissions
164
Member since
Feb 1
https://twitter.com/bdlowery2
View on Hacker NewsJoined 4 years ago
this bench was just released, it couldn't have detected opus 4.6 degradation.
And it just BURNS tokens like crazy.
Try and use gemini 3.8 yourself for any real world work and you'll see it's terrible. It'll just go in circles reading the same file 20 times for no reason making hundreds of tool calls for a simple change.
EDIT: I was using gemini cli... it's not a harness issue lol
make an x account then?
You can read it yourself - https://blog.codeberg.org/protecting-our-floss-commons-from-...