Comment by alphan0n

Can someone point out the authors robots.txt where the offense is taking place?

I’m just seeing: https://pod.geraspora.de/robots.txt

Which allows all user agents.

*The discourse server does not disallow the offending bots mentioned in their post:

https://discourse.diasporafoundation.org/robots.txt

Nor does the wiki:

https://wiki.diasporafoundation.org/robots.txt

No robots.txt at all on the homepage:

https://diasporafoundation.org/robots.txt