Ask HN: LLMs and Information Theory

In what ways do large language models reshape or expand our understanding of classical information theory, particularly around concepts like meaning, entropy, and communication?