Comment by Matsta

I'm getting around 90 tok/s on a 3090 using Ollama.

Pretty impressive