Comment
Comment by photonthug
I don’t know about that, we seem to be so deeply into double standards for this stuff that we’ve forgotten they are double standards. If I aggressively scrape content from anywhere and everywhere ignoring robots.txt and any other terms and conditions, then I’ll probably be punished. Corporate crawlers that are feeding the beast just do this on a massive scale and laugh off all of the complaints, including those from smaller corporations who hire lawyers..