Comment by jfreds

> The worst case of these were the few companies that set up token leaderboards, which is perhaps the dumbest way possible to encourage learning how to use LLMs well

My company does something dumber now. A leaderboard of how many lines of code you shipped, weighted by how complex they were (assigned by a heuristic). You can imagine the incentive this creates. I wish we just measured tokens