Ask HN: Is it fair that someone decide to follow your post and vote it down?

All for making a comment? Or just because they could? What would you like me to do? Remove all the news I posted? Give a newbie a break.