Comment by PumpkinSpice

The relative scarcity of castle sieges doesn't mean they weren't a major concern. It's quite likely that castles served as an effective "siege deterrent". That is, sieges weren't common specifically because the likelihood of success was low.