> I found this claiming an A100 can generate 1 image/s.
The article you linked is over a year old. Needless to say there have been a LOT of optimizations in the last year.
Back then it was common to use 50+ steps for many of the common samplers. Current methods use a few steps like 1. This OnnxStream are using SDXL-turbo, and you can combine LCM and a few other methods to go very fast.
The reason it's so much faster now is the OnnxStream is only using a single step.
However even if you only get 1 image/s with whatever GPU you have I stand by my original statement that unless you want to do it for the cool factor (which is very valid), pre-calculating them makes more sense.
The article you linked is over a year old. Needless to say there have been a LOT of optimizations in the last year.
Back then it was common to use 50+ steps for many of the common samplers. Current methods use a few steps like 1. This OnnxStream are using SDXL-turbo, and you can combine LCM and a few other methods to go very fast.
The reason it's so much faster now is the OnnxStream is only using a single step.
This repo claims 149 images/s on a 4090 https://github.com/aifartist/ArtSpew
However even if you only get 1 image/s with whatever GPU you have I stand by my original statement that unless you want to do it for the cool factor (which is very valid), pre-calculating them makes more sense.