Comment Comment by devicenull Just allow access from all of Google's IP space, as long as the user-agent contains "googlebot'. It's pretty trivial to do...Sure, some people could set up GCP instances and proxy it, but that's a very tiny percentage of people. parent devicenull 9 years ago
Sure, some people could set up GCP instances and proxy it, but that's a very tiny percentage of people.