Comment by ArchieMaclean

Presumably it came from Latin 'puppis' (aft, stern, poop deck) before the passing through French to English.