Comment by CamperBob2

No need to deploy it publicly. It's 7B, it'll run on a 3090.