Comment Comment by krackers What is "Per Layer Embeddings"? The only hit I can find for that term is the announcement blogpost.And for that matter, what is>mix’n’match capability in Gemma 3n to dynamically create submodelsIt seems like mixture-of-experts taken to the extreme, where you actually create an entire submodel instead of routing per token? parent krackers 1 year ago
And for that matter, what is
>mix’n’match capability in Gemma 3n to dynamically create submodels
It seems like mixture-of-experts taken to the extreme, where you actually create an entire submodel instead of routing per token?