This is something that's been on my mind for years. Some words or turns of phrase identify you as a member of a group[1]. If someone has any amount of hostility to that group, then using these terms is going to cause them to get angry/frustrated with what you have to say instead of actually listening to your argument on its own merits... or at least that's what I've noticed about myself. For a long time, certain terms or expressions would irritate me so much that I'd ignore what the person using them had to say, even though afterwards I found I usually agreed with much of it. Even knowing now that I have this response and actively trying to avoid it, it's still difficult to ignore.
[1] https://en.wikipedia.org/wiki/Shibboleth