Comment by tarruda

You should be able to run Llama 30B q4 on a RTX 3090. Check the table here: https://bellard.org/ts_server/

30B/q4 requires 20GB of RAM while 3090 has 24GB.