wr
hn
Top
New
Best
Ask
Show
Jobs
Back
s
sunilsandhu
Joined 8 years ago
Karma
112
Submissions
172
Member since
Jul 29
View on Hacker News
Recent submissions
Comment · 3 years ago
Hard to know what's going on without seeing your code setup and knowing more details, but it could be related to rate limits. You could consider using something like rotating proxies to help bypass some stuff. If you want to continue to use your own setup, you could integrate rotating proxies through a service. Dropping a link to one that we used for a couple of projects at my workplace.
[1]
https://get.brightdata.com/bd-solutions-rotating-proxies
[1] https://get.brightdata.com/bd-solutions-rotating-proxies