Comment by seomint

Why don't they just use robots.txt to keep themselves out of Google's index? User-agent: Googlebot Disallow: / Has Google stopped using that directive?