Comment by pornel

No, it's more like sharding of parameters. There's no understandable distinction between the experts.