asasidh
Joined 10 years ago
Karma
159
Submissions
196
Member since
Sep 4
Joined 10 years ago
Every prediction model is inherently a compressor, and all compression algorithms are prediction models.
Reference: Language Modeling Is Compression — Delétang et al., DeepMind, 2023. The prediction-compression equivalence, with the Chinchilla-beats-PNG result.