White people in these areas don't trust people from outside these areas. The only reason other people come to them is to paint the people in a bad light in some way or scam them (why else would anyone come? it's certainly not for work or pleasure). It has nothing to do with there being "a lot at stake," they just genuinely don't like outsiders.
source: from these areas.
edit: removed the "white" from people