Comment by rufasterisco

some small models are fast, and fine tuning can be done locally

for example in gaming context, if you need an answer below 5 seconds, they are the sweet spot