Comment Comment by johnc1231 How do they identify a crawler? Can a user not masquerade as a crawler somehow? parent johnc1231 5 years ago