Comment by badmonster

what's the best way to scale scraping-heavy services like this without getting blocked?