Comment by Chiron1991

That's why you can give guidance to crawlers using sitemaps.