Comment by thalesfc

Use selenium.py, it is by far the easiest and scalable solution out there. (believe me I have tried everything, beautiful soup, request.py, scrapy.py ... )