maltelandwehr
Joined 9 years ago
Joined 9 years ago
Based on my experiments (across hundreds of thousands of LLM chats) llms.txt does not have any measurable impact in the vast majority of scenarios.
The traditional search results suffer a lot because AI and AI content generation have enable a lot of aggressive SEO/spam plays.
Since a lot of websites link to MSN, Forbes, and the NYT, they have a high Page Rank. This is interpreted as "high authority".
With ChatGPT or Google AI Mode, you get all answers directly in the chat. And you can even ask follow-up questions. There is no need to click on a link.
From the data I have seen, 40% of searches on Google used to lead to a click to another website. In ChatGPT and Google AI Mode, this number is lower than 5%. One study (with a small N) even came to the conclusion that the number is 0%.
Gives me a weird/strange feeling.
We would just need a good system to a) keep humans in the loop and b) sort out bad actors.
LLMs cannot in real time find and read thousands of secondary sources. Especially not if some of these might have already disappeared or are not digitalized.
I can see a future where LLM labs a) donate to Wikipedia and b) contribute to it with agents that suggest edits and review facts.
There are many small tasks simple AI agents could handle.
For example: Go to every article in the English Wikipedia of a Spanish city. Check data like inhabitants, major, etc. and compare them to the Spanish Wikipedia article. (The assumption here is that the Spanish Wikipedia will be more up-to-date for Spanish cities than the English Wikipedia.) Double-check what is written in the Spanish article. Update the English article accordingly.
If such an agents is only allowed to create drafts, human editors could review them and we would get a lot of small updates in.