Comment by gpugreg

Those RTX 5090 numbers are bad. You can get over 200 tps with ninfer using NVFP4 and MTP.