Scraping the Web in Golang with Colly and Goquery b benjamincongdon.me 4 tampo9 8 years ago 0 comments
Bandwidth and IP limits are the most common bottle necks, but these can be solved using multiple proxies and ssh tunnels. Colly has built in support for switching proxies [1].
[1] http://go-colly.org/docs/best_practices/distributed/