Comment by not-a-llm

more dense tokens means more stuff to fit into the embedding space which is per token, so more work to disentangle later