Comment Comment by XCSme 5900x, 3090 24gb (slightly undervolted), 128gb ddr4, running via Ollama.I am benchmarking it now locally, will put the results and speed/tps on aibenchy.com parent XCSme 2 months ago
I am benchmarking it now locally, will put the results and speed/tps on aibenchy.com