M michaelnielsen.org How to crawl a quarter billion webpages in 40 hours (2012) 296 points allenleee 8 years ago 61 comments
