Comment by muxamilian

Yes but in my experience, LLMs are prone to cheating and implementing "shortcuts" that look functional but are in fact not really if you look closely. At the moment, you still need a human in the loop to make sure the LLM actually did what it promised and didn't cheat.