Comment by nev3rfail

I got pretty good results with my 3090 on Qwen 27b. Yeah, the rack is completely unusable when you launch the llm, but i wouldn't say its slow.

Btw, fellow 3090 user, some time ago i saw this: https://github.com/Zagitta/gpu-unlock

Can't try it personally because windows, but maybe it will help you.