Comment by devsda

I don't understand LLMs enough to know if this is a silly question or not.

Is it possible to build domain specific smaller models and merge/combine them at query/run time to give better response or performance instead of one large all knowing model that learns everything ?