Comment by closeparen

You do not need to put keys on the web sever’s disk to SSH onward from it. Use agent forwarding instead.