Comment by icandoit

Mixture of experts: Make each model world-class within a single domain. If adding one more common-sense QnA makes the calculus-bot even slightly worse at caculus, don't do it.

https://en.wikipedia.org/wiki/Mixture_of_experts