Comment by qsort

Without the axiom of infinity you can't show that there exists an infinite set in ZF.

i.e. you can't use anything infinite, including natural numbers. It's actually extremely restrictive to get rid of it.