Comment by ghaff

Although aspects of this sort of separation go much further back. Being from "the wrong side of the tracks" is an expression that probably dates to the 19th century. (Of course, that was less of an actual physical barrier.)