Comment by krossitalk

Having to point at a URL and crawl for pages seems awkward. Is there something I can directly integrate into my app? How would it deal with a login page?