One major problem with this scheme is that if someone steals (or subpoenas) your computer they can discover all your passwords just by looking at your shell history. A password manager that's secured by a strong password doesn't have that vulnerability.
Edit: As jroes pointed out below, this is not a problem.
Edit: As jroes pointed out below, this is not a problem.