Comment

Comment by elliotec

A robots.txt explicitly allowing LLMs has nothing to do with whether it was made for humans or not and is generally the right move assuming you want your site picked up and recommended by AI tools. No different than allowing search engine crawlers to pick it up and the authors focus on that is bizarre when the rest of the evidence is so stark.
parent elliotec 2 months ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton