Comment Comment by tristanMatthias > GPT-5.6 Sol on Ultrafast mode, delivering up to 750 output tokens per secondhttps://taalas.com/products/> delivering 17k tokens per second per user on Llama 3.1 8B model.Obviously this is a much smaller model, but I really can't wait for ASICs to take over the LLM space.Imagine running a model like Sol/Fable (even half the size with 60-70% of it's intelligence) on your own ASIC hardware. parent tristanMatthias 2 months ago
https://taalas.com/products/
> delivering 17k tokens per second per user on Llama 3.1 8B model.
Obviously this is a much smaller model, but I really can't wait for ASICs to take over the LLM space.
Imagine running a model like Sol/Fable (even half the size with 60-70% of it's intelligence) on your own ASIC hardware.