Comment by visarga

The SOTA model dilemma is that you have to pay more and more to train models that focus on less and less of the AI task market, because 95% of tasks can be done by cheap small models.