Comment by vlovich123

Training is really really expensive and open models are not getting funded by VCs. Distillation also doesn’t improve performance. Until training gets exponentially cheaper so that you can do it for a few hundred grand to train a competitive model, open models are labs trying to flood the market to get market share / undercut more successful labs, not a sustainable strategy that will extend indefinitely necessarily. It’s like claiming Uber and DoorDash are fantastic because their prices are so low - once they eat the market the prices become higher than ever.