Considering that but about robots.txt is true (and I feel it is true) what can one do. Are there no regulations (implemented or in planning stage) on any of the bodies which decide the standards?
At some point, content owner should be - technically - be having some control to be able to limit / control who accesses their content
At some point, content owner should be - technically - be having some control to be able to limit / control who accesses their content