Oooh, very interesting! I'm way out of my depth here but is the intuition that new concepts that by a) connecting other concepts across that space, or b) introducing entirely new dimensions, or c) some mix of both, change the distribution / clustering of concepts within that space, which impacts how well it compresses, which could be a measure of significance based on the change in compression?
It's like information theory for abstract concepts.
It's like information theory for abstract concepts.