Comment by layoric

Software is improving quickly so take these numbers as a snapshot performance at best. Strata has really shown how much performance is left on the table. I have a dual A4000 16gb (Ampere) on an old X99 dual Xeon E5-2680 v4 with 128gb of memory and Qwen 3.8 Flash Next at the IQ3-S size (~96Gb) runs at 65-75 t/s which is extremely useable.