Comment by stummjr

That's kind of what Scrapy's AUTO_THROTTLE middleware does.