Comment by vicpara

A lot of websites have robots.txt and sitemap.xml protected by cloudflare if you can imagine that. That's crazy.