Comment Comment by unexaminedlife https://www.ycombinator.com/robots.txt parent unexaminedlife 4 years ago