Comment Comment by YuukiRey I share examples of LLM fails on our company Slack and every week LLMs do the opposite of what I tell them.I say capture logs without overriding console methods -> they override console methods.YOU ARE NOT ALLOWED TO CHANGE THE TESTS -> test changedOr they insert various sleep calls into a test to work around race conditions.This is all from Claude Sonnet 4. parent YuukiRey 1 year ago
I say capture logs without overriding console methods -> they override console methods.
YOU ARE NOT ALLOWED TO CHANGE THE TESTS -> test changed
Or they insert various sleep calls into a test to work around race conditions.
This is all from Claude Sonnet 4.