Comment by skybrian

As far as I know Google's bot respects robots.txt and doesn't try to evade detection?