Comment by Mikealcl

You could do this without effecting normal traffic depending on uniqueness of ip doing the scraping.

Love the idea.