Comment by knaekhoved

Language ought to "cleave reality at the joints" - i.e. approximate an information-theoretically optimal encoding.

If you start screwing over the 99.9%ile case to slightly improve the remaining 0.1%, you are not approximating an optimal encoding.