Comment

Comment by jakswa

I'm testing this out as a dumb scout model alongside Qwen 3.8 Flash Next (IQ3_S, strata). Currently have it labeled as a "dumb but fast scout, findings should be verified" since some initial testing shows useful-but-sometimes-inaccurate.

on a 7900XT (20GB VRAM, ~800GB/s IO) w/ full context:

    - 8500 tok/s prefill/ingestion
    - 212 toks/s decode/generation
parent jakswa 12 days ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton