doktor_pepsi

The beauty of Hackernews, no way to determine whether it's a clueless boomer from old-tech days or a high IQ individual layering the joke even further.

Appreciate providing this benchmark. I am curious, do you think that as new models (from the same company) are released and you repeat the benchmark, they adapt/extend their training data to include your dataset, thus polluting the benchmark results? Would you be doing anything to combat this?