Comment by erwincoumans

Bits of information depend on the readers prior knowledge, those bits are not absolute numbers. That makes communication not just information exchange but also syncing of priors. So some amount of redundant information maybe needed/wanted.