Comment Comment by tomschwiha I'm confused about the ToS comment by Cloudflare. The txt is on a website so it is a web content?So robots.txt is not supported by Cloudflare to cache/proxy it? That would be a weird regulation. And I bet everyone violates the Cloudflare ToS then. parent tomschwiha 4 years ago
So robots.txt is not supported by Cloudflare to cache/proxy it? That would be a weird regulation. And I bet everyone violates the Cloudflare ToS then.