Pedantic aside: This isn't the right way to use this phrase. The exception that proves the rule is the data point that demonstrates that it makes sense to call it a rule and not just something which is always true.
'Dogs bark' is proven a rule by cats meowing, not by a dog that doesn't bark
'Dogs bark' is proven a rule by cats meowing, not by a dog that doesn't bark