I think my only issue with using this is that it forces everyone to use gpt if they want to remain competitive. Which is already the case for many other tools, for example people had to learn z3 smt solvers for previous years.
But the main difference here is that there's no differentiation between the top competitors anymore. It just means in addition to being very good, you still need to run this thing in the background to hedge against this being an easily gpt-able problem while you code up the real solution. And in the cases where it is gptable, you can expect the leaderboard to be ranked only based on latency to openai/aoc servers.
But the main difference here is that there's no differentiation between the top competitors anymore. It just means in addition to being very good, you still need to run this thing in the background to hedge against this being an easily gpt-able problem while you code up the real solution. And in the cases where it is gptable, you can expect the leaderboard to be ranked only based on latency to openai/aoc servers.