We're sharing a free and public llms.txt generator and endpoint.
Our approach: we crawl your main page, then parse metatags and links to construct the llms.txt. The key is that this process happens without relying on any LLMs, which keeps it very fast and our operational costs extremely low. This allows us to offer it completely free.
Check it out on the homepage, or just send a GET request:
Our approach: we crawl your main page, then parse metatags and links to construct the llms.txt. The key is that this process happens without relying on any LLMs, which keeps it very fast and our operational costs extremely low. This allows us to offer it completely free.
Check it out on the homepage, or just send a GET request:
https://get.llms.page/{yourwebsite}/llms.txt
We'd appreciate any feedback or suggestions for features/improvements.