Comment by amirouche

Did you think about database dump of popular services like HN, SO or Wikipedia to speed up crawling and revelance?