Comment
Comment by billypilgrim
Not the one you asked but I genuinely think it’s possible that a part of the answer is the psychological effect of getting used to models performing well and picking up more if they fail, but also … If you have a product that works well for 95% of software engineering tasks (for the sake of this argument), with a large number of users there will inevitably be some poor schmucks who get bad results multiple times in a row. It would be highly unlikely if that _didn’t_ happen at all.
Now assuming you have millions of users, there will always be groups of thousands that experience this, and if those people go online to complain, it will look like an actual issue when it can just be explained by randomness and large numbers.