Ask HN: How do you earn a living from scraping in 2018?
I have been scraping housing markets. LinkedIn paired with hunter.io for creating mailing lists of companies. Recently I started MITM and Burp to intercept Apps to get direct api access. I created a docker container using different tor endpoints for different ips. I even used ssh proxying to create my own ip network.
To bypass recaptcha I build a container with chrome + puppeteer with anticaptcha preinstalled and pre logged in.
Yet I wonder if it is still worth it. Kinda looking for a mentor or inspiration.
Been a long time HN reader and I wonder what you think? Why scraping is still worth it in 2018?
To bypass recaptcha I build a container with chrome + puppeteer with anticaptcha preinstalled and pre logged in.
Yet I wonder if it is still worth it. Kinda looking for a mentor or inspiration.
Been a long time HN reader and I wonder what you think? Why scraping is still worth it in 2018?