Comment by j45

Docker could be run on the VPS, and the storage leg could be encrypted.

I'm presuming some VPS providers allow converting your VPS disk image to something that supports encryption.