Comment Comment by Jskewel Impossible. The majority of websites firewall automated crawler traffic (because of the rise of the bots), only making exceptions for the largest search engines. There is no possibility of starting a new crawler. parent Jskewel 1 month ago