interesting data and results. it kind of looks like they are good at coding plainly no buffer overflows or such things, but as noted application logic is the trick. Things that are difficult for humans (authentication, paralelism) seems also tricky for them.
Id wonder if they are badly putting together the logic from good instructions or that the prompting was missing pieces and it followed correctly but provided some broken code due to missing requirements / details.
Id wonder if they are badly putting together the logic from good instructions or that the prompting was missing pieces and it followed correctly but provided some broken code due to missing requirements / details.