Comment by FieryMechanic

The way most scrapers work (I've written plenty of them) is that you just basically get the page and all the links and just drill down.