The Chinese companies will not stay "open" if it doesn't serve their economic/political interests.
Why is there not yet fully open models made by/for the FOSS community (as opposed to open weight by entrepreneur-style companies)? Cost of training? But what is this cost really?
- Do not include costs of running model in cloud
- Do not include IP costs
- Do not include salaries, marketing, etc.
(all these are separate expenses, different depending on individual goals)
There would be pre- and post- training "systems" that could be repeated.
Training data/acquisition could be separated out (so IP-liabilities could be taken on by individuals).
The idea would be a system for small groups/individuals to snap together the different aspects of training (data, pre-training, training compute, post-training) and to train their own (and share).
Won't this soon come down to a few thousand dollars for models that run on modern consumer hardware?
Why is there not yet fully open models made by/for the FOSS community (as opposed to open weight by entrepreneur-style companies)? Cost of training? But what is this cost really?
- Do not include costs of running model in cloud - Do not include IP costs - Do not include salaries, marketing, etc. (all these are separate expenses, different depending on individual goals)
There would be pre- and post- training "systems" that could be repeated.
Training data/acquisition could be separated out (so IP-liabilities could be taken on by individuals).
The idea would be a system for small groups/individuals to snap together the different aspects of training (data, pre-training, training compute, post-training) and to train their own (and share).
Won't this soon come down to a few thousand dollars for models that run on modern consumer hardware?