E.T. Jaynes book, "Probability Theory: the Logic of Science" may come close to what you want. It emphasize that there are rules of thought, which lead to Bayesian statistics. As such, Bayesian statistics aren't just a recipe, but the law.
Now, I can only personally vouch for the first 2 chapters, as I haven't read the rest yet.
Now, I can only personally vouch for the first 2 chapters, as I haven't read the rest yet.