TheMrZZ
Joined 3 years ago
Joined 3 years ago
But having so many of them at once? Damn. We really live in the future.
> Unnecessarily aggressive
> First ever comment said "Further releases of Chinese models that demonstrate the gap is not growing substantially is a huge problem. The spending will be called into question."
Yeah I think you have an agenda
They were never told to lie: one AI is given more information than the others, and the goal of the experiment is to understand how they're gonna leverage that advantage.
Indeed the selfish (optimal?) strategy is to lie, yet some decide to tell the truth anyway. That's why it's an interesting benchmark! More info in the research article: https://kradle.ai/research/four-bridges (released before Fable)
This seems impressive. I don't know much about the space, so maybe it's not actually that great, but from my POV it looks like a competitive advantage for Google.
For client side MCP it's a different story.
Though I'm aligned that I don't (yet) believe in this "AI writes all my code for me" statements.
Results can be found in this GSheet: https://docs.google.com/spreadsheets/d/1tsBhElTgXjVTeas8quar...
Code is here: https://gist.github.com/TheMrZZ/c33927ca2cc917997a67d7f84b82...
I'm currently running the 3-variables version, hopefully I'll get results this afternoon.
We can clearly see the same problems that arise in the 1-variable Simpson's paradox (widely different population sizes).
Also, faster feedback loop is crucial for AIs, so I guess this makes sense.