Comment by DantesTravel

I've recently discovered on a substack about web scraping the existence of anti detect browsers. Using Selenium or Playwright you can automate these browsers, each can have hundreds of isolated profiles, with different fingerprints and cookies. If you add also a proxy layer, you should be ok.