B blog.scrapinghub.com How to Crawl the Web Politely with Scrapy 139 points stummjr 10 years ago 41 comments