I just realized benchmarks are the trading card PSA of AI.
The numbers are fuzzy and hard to verify, especially if benchmarks are private, putting authenticators in a powerful position to determine market value of AI in countless ways; a recipe for corruption. I'm not saying it's happening, I just realized the social ingredients and temptation are there.
The numbers are fuzzy and hard to verify, especially if benchmarks are private, putting authenticators in a powerful position to determine market value of AI in countless ways; a recipe for corruption. I'm not saying it's happening, I just realized the social ingredients and temptation are there.