> People are realizing that what they need isn't more general intelligence, it's more specialization. A small but well tuned coding model...
It’s not quite as simple as that. Several studies have shown the opposite: models trained on more diverse knowledge tend to cross-pollinate across domains. So a more generalized model can actually perform better than a specialized one.
That’s why you’re not seeing tons of tiny models (one for Python, one for Pascal, one for Rust, etc).
It’s not quite as simple as that. Several studies have shown the opposite: models trained on more diverse knowledge tend to cross-pollinate across domains. So a more generalized model can actually perform better than a specialized one.
That’s why you’re not seeing tons of tiny models (one for Python, one for Pascal, one for Rust, etc).