Comment Comment by CDRdude Isn’t it somewhat likely that a lot of shady crawlers pretend to be a google bot with their user agent? parent CDRdude 9 months ago