Training a frontier model is prohibitively expensive, so it’s understandable that open weights aren’t truly open source. In fact, I worry whether open weights will even survive[1] once the current AI cycle cools down. An even bigger issue is that as long as model development remains this capital intensive, a genuinely open-source community around frontier AI is virtually impossible. That will have massive implications for our careers. The more capital concentrates at the top, the less leverage we’ll have in the job market.
[1] Arguably hardware companies like Nvidia have incentives to subsidize open models to drive GPU demand. That said, I'm not sure how sustainable and sufficient that incentive can be.
Training a frontier model is prohibitively expensive, so it’s understandable that open weights aren’t truly open source. In fact, I worry whether open weights will even survive[1] once the current AI cycle cools down. An even bigger issue is that as long as model development remains this capital intensive, a genuinely open-source community around frontier AI is virtually impossible. That will have massive implications for our careers. The more capital concentrates at the top, the less leverage we’ll have in the job market.
[1] Arguably hardware companies like Nvidia have incentives to subsidize open models to drive GPU demand. That said, I'm not sure how sustainable and sufficient that incentive can be.