Case. Must have case. A bare board is not a consumer product. Consider just dipping the thing in Plasti-Dip, without submerging the connector. For a better feel, put the button on the solder side side, and put a thin piece of plastic U-channel sized to fit the board over the component side to give it a flat surface. Then Plasti-Dip. No custom injection molding, and the user can still push the button through the Plasti-Dip.
Other than that, great idea. It's how PayPal started.
Other than that, great idea. It's how PayPal started.