Comment by dr_dshiv

The thing about Shannon entropy is that it depends upon alphabets and symbol systems. I want to understand how it might be used to describe presymbolic computational systems.