Comment by icedchai

Yep. There's a lot of room for error when you start by asking the wrong thing, then don't understand the output. I've seen prompts that were literally "fix it", then the LLM goes and changes assert status == 200 to 500. Tests pass now! Problem solved!