>An interesting observation we made was that even though the 3 optimizers were given tens of thousands of dollars in compute, they found the best solution very early on
Honestly, this confirms some bias I already have from coding — models can get to the best solution pretty fast, but if the solution is something obscure, they usually don’t find it.
Honestly, this confirms some bias I already have from coding — models can get to the best solution pretty fast, but if the solution is something obscure, they usually don’t find it.