Comment by saurik

I don't see how being a hobby site makes it more sustainable to have crawlers making insane numbers of constant requests to your server for seemingly no good reason? If what used to be a website you could host for some small number of people who cared scaled well now it is a hundred times more expensive to run.