Comment by jeremyloy_wt

Admittedly I’m pretty ignorant of the details, but I thought this was the mixture of experts architecture