I don't think you are using that right. Saying someone is bringing a bad vibe to your project, as the point he has a bad vibe is just stating the conclusion.
Like if someone calls you a bad programmer and doesn't hire you as a programmer, isn't ad hominem
Like if someone calls you a bad programmer and doesn't hire you as a programmer, isn't ad hominem