Comment by horseradish7k

but not when crawling. you don't know the page format in advance - you don't even know what the page contains!