As I understand it, anything publicly viewable is free to be scraped without issue.
If you scrape stuff behind a sign-up, you potentially open yourself up to being sued for breach of ToS.
Now I'm sure the Chinese labs don't give a rats arse about that threat, but I imagine it stops the likes of Google, OAI, Anthropic from scraping and instead forces them to purchase the data.
If you scrape stuff behind a sign-up, you potentially open yourself up to being sued for breach of ToS.
Now I'm sure the Chinese labs don't give a rats arse about that threat, but I imagine it stops the likes of Google, OAI, Anthropic from scraping and instead forces them to purchase the data.