Comment by fukd

Back in 2018 i crawled 200Million urls of single site by using just freely avilable proxies on the internet to evade rate limits. i do not think it can be repeated today.

CDNs are blocking even my genuine requests.