On the topic of trusting surprising observations, I remember a quiz at school where almost everyone had the same failure mode.
First question: "read all the questions before answering"
Questions 2-99: Trivial but interestingly bizarre questions, like "draw a triangle with blue ink"
Question 100: "Now you have read all the questions, answer only questions 1 and 2"
I was very tempted to make the mistake everyone else made, and quite smug when I finished, sitting and watching as everyone else asked for ink and later on ink erasers.
First question: "read all the questions before answering"
Questions 2-99: Trivial but interestingly bizarre questions, like "draw a triangle with blue ink"
Question 100: "Now you have read all the questions, answer only questions 1 and 2"
I was very tempted to make the mistake everyone else made, and quite smug when I finished, sitting and watching as everyone else asked for ink and later on ink erasers.