Comment by technobabbler

Google was definitely better than the algorithmic crawlers. But Yahoo often still had gems for a while, a few years maybe, before they gave up. It's too bad.