That justification is more acceptable, but still a poor excuse (which doesn't sound like your fault), and if anything highlights the problem with the focus of user-centered design.
I'm sure you'd agree, design isn't a democracy. Clearly, your users are wrong.
I'm sure you'd agree, design isn't a democracy. Clearly, your users are wrong.