Comment by gpugreg

    > LLMs are super lazy about caring about wall clock time.

My bandaid for problem is to prefix every bash command with "timeout 60 " at the harness level and remind the LLM to hurry up. Of course, this is not a perfect solution, since LLMs might try to run jobs in the background or split up work into smaller pieces instead of running smaller experiments. And of course this does not help with the multi-million dollar training runs, but it has served me well most of the time.