Comment by jraph

Hardly legally enforceable, no? robots.txt is nothing more than a gentle request.

edit: even Twitter don't really have much faith in those rules:

    # Every bot that might possibly read and respect this file
    # ========================================================
    User-agent: *
    Disallow: /

"might possibly". lol. Really sounds like "probably won't work but can't hurt, eh?"