Comment by holografix

What’s the end goal for Cloudflare and the web here? I don’t think ADOG (anthropic, deepmind, openai, google) is going to pay to crawl.

What would force their hand?

It’s more likely they’ll strike undisclosed agreements with major sources of discussion like reddit etc.

That’s not to say getting new information as a way of context-providing is not going to happen but that’s not scraping.