Comment by nzadrozny

For that, I use Bundler and always install gems to vendor/bundle for maximum isolation and easy cleanup.

:~ which bi

bi: aliased to bundle install --path vendor/bundle