Comment by rithdmc

This seems neat. My previous experience has been with scrapy, but if you're using books.toscrape, then you probably already know of it.

I'll keep this in mind as an alternative next time I'm scraping something.