Comment by o1y32

I am not a lawyer but I am pretty sure a website protected with a password and/or firewall means something different from a robots.txt that is nothing more than a convention.