Comment by ScottWRobinson

IIRC there are ways to give an authentic-looking fingerprint to browsers used for scraping. But as you said, it's a cat and mouse game