There are services that cover at least part of what you mentioned. These effectively provide you a tool to visually build a scraper and then they automate the scraping in the background, creating an API or spreadsheet of the data.
Import.io is one example, and I think there's another more recent YC-backed one. However, I tried using import.io a little while back but without much joy.
Import.io is one example, and I think there's another more recent YC-backed one. However, I tried using import.io a little while back but without much joy.