rabbitlord
Joined 1 year ago
Karma
27
Submissions
20
Member since
Sep 4
Joined 1 year ago
Although open weights in theory are good, especially for developers and market competition, it is not as wonderful as you thought.
Distillation also directly inherits a frontier model’s alignment and behavior, without paying the underlying R&D or safety costs. That may be a different incentive problem than web scraping.
This feels similar (even if not identical) to a pharmaceutical company reverse-engineering a drug developed through years of costly R&D. It surely can lower prices and expand access to more people, but it’s not obvious that this is a long-term win-win situation. I don't know.