Comment by UniZero

Contrary to popular belief, a lot of high traffic sites can be scrapped by a single IP without hitting access limits.