Comment by cheekygeeky

Daniel, GREAT job. This is fascinating. Your leaderboard is based upon ELO, correct? I can't find anywhere that you describe the formula for calculating the ELO score. It seems like we would need to verify that is indeed an accurate way to judge the Model Leaderboard. Care to share? Also, if you gave them DIFFERENT arbitrary ratings to start, that would definitely influence their calculated ELO's later, wouldn't it? Why not start them off with even ELOs (like all starting at 1500)?