Your first problem is that two and three families cost more per square foot to build than single family detached and they sell at a discount to single family detached. As you go up the chain, it gets even more expensive per square foot. Anything other than single family only makes sense when land gets really expensive, and/or when it is subsidized.
Your second problem is democracy.