Comment

Comment by pawnednow

Cloudflare aggressively deters bots and Google's bot usually get caught out in this due to their automated behaviour. I have seen cloudflare strangle and limit Google bots activity leading to lower crawl on most sites using cloudflare.
parent pawnednow 6 years ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton