Nice setup; but, for simple tasks or questions, AI is currently free? And it will probably stay free, as I don't see Google starting to charge for using AI on its search engine? So costs can't be a motivation for running small models locally?
For more complex or important tasks, costs, autonomy and privacy matter, but then so does performance/quality.
So I'm not completely convinced it's really worth it; but it's tempting!
For more complex or important tasks, costs, autonomy and privacy matter, but then so does performance/quality.
So I'm not completely convinced it's really worth it; but it's tempting!