Comment Comment by klodolph That sounds like the desired outcome here. Your agent should respect robots.txt, OR it should be designed to not follow links. parent klodolph 11 months ago