Comment Comment by flir Koomey's law is a pretty safe bet.When Taalas burned Llama 3.1 to the HC1 they saw at least an order of magnitude more tokens per joule. That saving is sitting right there, today, ready for anyone who is willing to say "this is the model we're freezing on for a couple of years". parent flir 25 days ago
When Taalas burned Llama 3.1 to the HC1 they saw at least an order of magnitude more tokens per joule. That saving is sitting right there, today, ready for anyone who is willing to say "this is the model we're freezing on for a couple of years".