Recent submissions

Comment · 1 year ago
We use a new browser for each session you create! We don't share the browsers between different customers.
Comment · 1 year ago
Comment · 1 year ago
We will definitely look into it! As we are adding more users scalability is our primary concern right now though
Comment · 1 year ago
Of course, would love for you to take a look! I mentioned in another comment but we are working on lower cost/faster scraping focused endpoints, It's coming next week
Comment · 1 year ago
We keep "prewarmed" browsers ready for new sessions. Looking into firecracker though!
Comment · 1 year ago
We don't have that yet, but you could definitely do it in your own scripts right now using our browser. We'll try to think of ways to make it easier though :)
Comment · 1 year ago
Thank you! We do make sure we are using legitimate proxy providers. Also happy to manually set it to the provider of your choice if you are interested in doing that :)
Comment · 1 year ago
Hey! Completely hear you on that, right now we just have endpoints for headless browsers, this is a instance running chrome with dedicated resources that you have full access to. This comes with proxy services and captcha solving. This comes at a higher cost but you will get blocked less and can do much more, like browser automations.

Dedicated endpoints for just scraping like scraping bee are coming next week at a discounted price! In the mean time let me know if there is anything you would like that scraping bee is missing :)

Comment · 1 year ago
We actually keep a pool of browsers ready so when a request comes we just assign it to an already running browser. This way in most situations there is no actual waiting for chrome to startup!
Comment · 1 year ago
Just docker containers in GCP and AWS. We do all the instance management ourselves. It seems like you are working on infra for this from your bio! Send me an email would love to chat :)
Comment · 1 year ago
Hey! So we have to use a different proxy service for some sites (LinkedIn included). Just ask in the app support and we can do that. We are also making custom endpoints for LinkedIn as well that should be ready soon, Ill shoot you an email once we have that!
Comment · 1 year ago
Hey, 100 max on our paid plan but I can enable 1k concurrently if you want!

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton