You can't really "add" your key to a computer you don't trust, though. At best, it could destroy your USB device; at worst it could copy the contents out once you decrypt them.
This may be better than using one password for everything, but it's certainly not a panacea.
This may be better than using one password for everything, but it's certainly not a panacea.