See https://en.wikipedia.org/wiki/Surrounded_by_Idiots for the case that people generally aren't stupid, they're just different - personality, upbringing, culture, etc. Being smart is knowing how to spot those fundamental differences, interpreting them for what they are and adapting your behaviour.
But there are also proper idiots.