Comment by cscurmudgeon

I wouldn't say they define the natural numbers. A more apt phrasing would be "describe the natural numbers." They are more like the laws of physics for the natural numbers.

Also, there are easily understandable theorems about the natural numbers not provable from the Peano axioms.

http://en.wikipedia.org/wiki/Goodsteins_theorem