Comment by saimiam

I have a react app website which seems to break your crawler. A future enhancement may be to run JavaScript inside the crawler to generate the site.