Comment by tomaskafka

Thanks! I think you’re right, that’s a valuable observation I missed.

Analogous to how we create “bottleneck layers” for image generation/recognition, forcing the models to create semantic representations instead of memorizing.

I feel that doing this for LLMs at runtime is severely underexplored.