Comment by sreekanth850

And you think all this web AI crawlers will respect robots.txt. That era is gone.