Comment by armanj

This part of a recent talk points out exactly this problem, and (likely) why human expertise will remain important in the age of LLMs doing everything: https://youtu.be/X7vf7koPxKg?t=2806