Comment by mountainriver

Yep, the interesting thing is genetic algorithms previously were mostly good at course search and less good at fine search.

They also often converge to a local minima, and are costly.

It’ll be interesting to see if LLMs change that, or whether we are just approximating something a gradient could do better