Comment Comment by grandmczeb Your home setup is much less efficient than production inference in a data center. Open source implementation of SDXL-Lightning runs at 12 images a second on TPU v5e-8, which uses ~2kW at full load. That’s 170J or about 1/400th the phone charge.https://cloud.google.com/blog/products/compute/accelerating-...https://arxiv.org/pdf/2502.01671 parent grandmczeb 1 year ago
https://cloud.google.com/blog/products/compute/accelerating-...
https://arxiv.org/pdf/2502.01671