Comment Comment by stygiansonic From the article it appears to be something they invented:> Gemma 3n leverages a Google DeepMind innovation called Per-Layer Embeddings (PLE) that delivers a significant reduction in RAM usage.Like you I’m also interested in the architectural details. We can speculate but we’ll probably need to wait for some sort of paper to get the details. parent stygiansonic 1 year ago
> Gemma 3n leverages a Google DeepMind innovation called Per-Layer Embeddings (PLE) that delivers a significant reduction in RAM usage.
Like you I’m also interested in the architectural details. We can speculate but we’ll probably need to wait for some sort of paper to get the details.