When running benchmarks mind how some providers lobotomise some models. For example DeepSeek Flash is fine when run via DeepSeek. The same model via Deepinfra and open router (despite setting routing to "exact") was far worse.
Regarding Qwen3.8-Flash-Next only Alibaba matches the quality I get when run local inference.
Mind I run mxfp4 and int8 kv (before I run unsloth's q4_xl). And it is much more capable than providers that claim full precision. I have no idea what they do to mess it up, maybe they quantize the kv?
Regarding Qwen3.8-Flash-Next only Alibaba matches the quality I get when run local inference.
Mind I run mxfp4 and int8 kv (before I run unsloth's q4_xl). And it is much more capable than providers that claim full precision. I have no idea what they do to mess it up, maybe they quantize the kv?
Either way the provider you choose matters a lot.