lt
Joined 17 years ago
Joined 17 years ago
It has learned to make pixels a particular color to mimic that style, but that's it.
2018 They got funding to research it further,
2020 was a first attempt of publication at Nature that was retracted, further improvements were made until 22/23 were two patents were filled, then suddenly 10 days ago Kwon, one of the co-researchers jumped the gun publishing a paper with the details, on one hand fearing a leak of someone else publishing first as that was too simple to replicate, on the other hand excluding everyone else from the paper and only listing him and Lee/Kim (LK) as authors as a Nobel prize can only be shared by three people. 2.5hrs later LK published again listing other 5 authors but him.
So 512 is really inadequate unless you just want to make search queries using natural language.
First, Reddit's monetization is broken by design. It never made any sense to me why they would charge for reddit gold for an ad-free experience on their website and own mobile app but not on the API. Why would they let third party apps serve their own ads and let them charge to remove them? This would be simple to fix, both technically and in the API's ToS, just serve the same ads regardless of the client. People would be upset, but ultimately I feel it would be entirely fair. But no, it doesn't seem to be a solution considered.
Second, the LLM dataset issue is also attributed to the price hike. Again, I think it's fair if unpopular to charge premium for bulk data. Again, there are technical and ToS solutions for this. They could introduce exponential tiers for bulk data, restrictions on allowed usage, other things that make user-facing usage reasonable but bulk processing expensive, but then again, starting measuring api usage per client id and not per user goes against this point, just making the API extremely expensive for everyone anywhere to the point of being unusable.
Third, all points seem to lead to the fact that what they really want is to kill third party apps and hope a large part of those users move to their app, for what? More tracking, tighter grip, better engagement metrics? Not sure. Even the changes to the extremely hostile mobile site now forcing some users to download the app. Really, I'd figure they'd understand their userbase better than that and how a small fraction on content producers and a even smaller fraction of power users and moderators carry the site, and pissing them off is a really bad idea. But what do I know.
The first few releases of model and code have been done by Compvis, and this one by RunwayML. More than permitted by the license, this seems to have been released by the actual developers.
I've seen speculation that it has been released this way to provide distance between Stability.AI from eventual future litigations, but it feels more like an internal ultimatum deadline.
A possible better editorialized title would be
Creating a parallel kernel so we can continually rebase commits instead of every two years
You claimed the model can reproduce an image from that training data. That's false, and what the judge dismissed.
Whether using copyrighted data to train a model is fair use or not is a different discussion.