Comment by mkl

> I've built crawlers that retrieve billions of web pages every month.

Wow, what were you doing with the data?