There’s not even a need for armed men on horseback. The lord/patron is your protector against overly draconian laws where just about everything is punishable by death. Lose the patron and next time you e.g. look at the neighbors’ wife, you get to be shorter by a head for entertainment of the folks with a patron. Some of these patron’d folk might have killed somebody last week for which they get to spent time with a priest working on the salvation of their soul and no further punishment.
Source: Inventing the Renaissance by Ada Palmer