Comment by leeknoww

The point about govdeals missing is real, but in practice most of these sites block scraping aggressively for good reason. The operational cost of maintaining scrapers against hostile targets is non-trivial. Curious what the OP's plan is when they start rate-limiting or serving honeypot data.