It's telling that nearly every site listed is directly involved with AI in some way, unsurprisingly the broader internet isn't particularly interested in going out of its way to make its content easier for AI companies to scrape.
Deliberately putting garbage data in your llms.txt could be funny though.
Deliberately putting garbage data in your llms.txt could be funny though.