Comment by wnmurphy

Yeah, I'm looking forward to this actually.

https://chatjimmy.ai/ blew my mind at how fast etched model weights can be.

For on-device LLMs, there's a point of diminishing returns, meaning you don't need to have the latest frontier model for most operations.