Comment

Comment by olegus8

Take a look at Weboob (http://weboob.org). It's an attempt to create a well-defined uniform API for websites lacking one. I wrote a few modules for it, and they're scraping 4 banks and 4 shops on a daily basis for last few months.

As I see it, upside of this approach is that you can scrape pretty much everything you can open in your browser. Downside is that you have to update your scraper every time website changes. From my personal experience this happens at least once a month.

parent olegus8 11 years ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton