Ask HN: Would it be legal if I put my web scraping scripts (lib) on GitHub?
Hi, I am using the data for research purposes. How bad it is to show scrappers in my Github account.
I am using scrappers to collect data from news sources, analyze them and work on some data analysis tools (recommendation sys, data visualization of aggregated data, .. etc).
I tried to consult with some other people in the field, but most of them gave mixed signals, and recommended articles like [1](https://gijn.org/2015/08/12/on-the-ethics-of-web-scraping-and-data-journalism/).
As far as I know, some big companies like BBC do have some scrapping tools like [Juicer](http://bbcnewslabs.co.uk/projects/juicer/). Any one of you got into troubles by putting such scripts publicly.
I tried to consult with some other people in the field, but most of them gave mixed signals, and recommended articles like [1](https://gijn.org/2015/08/12/on-the-ethics-of-web-scraping-and-data-journalism/).
As far as I know, some big companies like BBC do have some scrapping tools like [Juicer](http://bbcnewslabs.co.uk/projects/juicer/). Any one of you got into troubles by putting such scripts publicly.
Best,