Comment by IronWolve

Getting about 200 tok/s on a 5090 with 64 gigs of ram, running the swift iq2_xs quant, ukisai/Swift-1.5-Qwen3.8-Flash-Next-GSQ-RCO-GGUF with strata. There are other smaller flash next quants if you have 8gig vram too.