Comment by mehsan769

The cost of crawling will be many times lower than Apache Nutch.

It's fully managed: nutch is NOTORIOUS for being hard to set up and maintain. It could take you months before you can launch a mid-scale crawl using nutch...