Comment by noosphr

I guess the google bot is now on by blocked list.

There should be a public corporation, like Wikipedia, that starts scraping the Web and provides an api for anyone to access.