> What makes you look at existing AI systems and then say "oh, this totally isn't capable of describing a problem or figuring out what's actually wrong"?
I wouldn't say they're completely incapable.
* They can spot (and fix) low hanging fruit instantly
* They will also "fix" things that were left out there for a reason and break things completely
* even if the code base fits entirely in their context window, as does the complete company knowledge base, including Slack conversations etc., the proposed solutions sometimes take a very strange turn, in spite of being correct 57.8% of the time.
I wouldn't say they're completely incapable.
* They can spot (and fix) low hanging fruit instantly
* They will also "fix" things that were left out there for a reason and break things completely
* even if the code base fits entirely in their context window, as does the complete company knowledge base, including Slack conversations etc., the proposed solutions sometimes take a very strange turn, in spite of being correct 57.8% of the time.