This article is a bit dated. AFIK the latest in web scraping legality is LinkedIn vs. HiQ, where HiQ was scraping public LinkedIn profiles. LinkedIn issued a C&D under CFAA, but HiQ received an injunction that allowed it to continue scraping. This was supposed to be tried in the Ninth Circuit court over a year ago, but not sure what happened
https://www.eff.org/cases/hiq-v-linkedin