Beautifully ironic. This post argues against being convinced by LLM statistics, by showing (presumably) human statistics with so many "Don't Trust Me" flags.
1. Unverifiable source ("a meta-analysis", trying to get authority without actually having it.
2. Hyper-specific numbers without error bars (and source), pretending to have certainty and precision.
3. Shockingly large number, intended to get an emotional reaction and a sense that it rounds to "all".
4. Numbers align too neatly with the point being made. They could still be true, but there could also be some overinterpreting, stretching of the truth or just plain lying going on.
Beautiful demonstration that numbers intended to convince are never to be trusted outright. No notes.
As an aside, the whole freak-out about LLM hallucinations has mostly shown me that way too many people accept human numbers way too easily. People are frequently as dumb or even dumber than LLMs.
1. Unverifiable source ("a meta-analysis", trying to get authority without actually having it.
2. Hyper-specific numbers without error bars (and source), pretending to have certainty and precision.
3. Shockingly large number, intended to get an emotional reaction and a sense that it rounds to "all".
4. Numbers align too neatly with the point being made. They could still be true, but there could also be some overinterpreting, stretching of the truth or just plain lying going on.
Beautiful demonstration that numbers intended to convince are never to be trusted outright. No notes.
As an aside, the whole freak-out about LLM hallucinations has mostly shown me that way too many people accept human numbers way too easily. People are frequently as dumb or even dumber than LLMs.