kamran210

Exactly, and even without sitemap ai can crawl the webpage content for internal links.

Not to mention the environmental impact of creating extra files just for AI to crawl and eventually use for training

Honestly, I don’t see a point in adding llms.txt file when all the information is already available on internet.

So, i am staying away from them as principle.

misspelling gives you a hint about my expertise in llms.txt files

What do you think about mine? at fyikamran.com/llm.txt