Comment by tichiian

That's baby+bathwater.

Just use ssh-add -c to have the ssh-agent confirm every use of a key.