Show HN: Token Thermodynamics
We often focus on tokens/second and dollars/token, but rarely on the environmental cost per token. This work presents a step-by-step analysis of the energy and water footprint of LLM inference.
Be the first to share your thoughts.