Comment by akriukas

Very useful for some big eshops if they list their sitemaps. However not all stores have sitemaps and even robots.txt site...