Comment by chptung

So I decided to google around and I think TikTok does ignore robots.txt. A few posts from around:

- https://www.reddit.com/r/flask/comments/161fqml/what_to_do_a...

- https://www.reddit.com/r/sysadmin/comments/1ahhzdg/has_anyon...