tpurves
Joined 19 years ago
Joined 19 years ago
Note amazon has a competitor to this that I tried out, the echo show. It's horrible as it just shovels advertisements at you all the time.
I remember even trying this with a cheap HDD->SSD upgrade as well, but by that point they had implemented drive encryption so that foiled that effort.
(as long as you take similar assumptions in die size, advanced packaging and power envelope).
my impression right now is that M5 gen is on the cusp of practicality for local inference.
If techniques like OPs here, start to make the RAM situation more amenable, by the time we get to M6 or M7 (or AMD's equiv next gen APUs on TSMC N2 nodes), local AI could be ready to go much more mainstream.
I Imagine next that programming languages, interfaces and API design starts going this direction next. Being written, expressed and optimized as blobs of high dimensional vector space. As humans we might still be able to understand some abstractions of what our AI's are talking about to each other, but maybe not more so then we understand how different regions of our own brain communicate with each other.
However the logistics costs of fragmentation are very real (relevant to the supply chain theme of this story). And now that Ukraine is producing the better part of 10 millions(!) of drones per year, they are shifting towards more standardized drone models to simplify logistics, achieve more economies of scale and also now to have the capacity to keep units equipped more evenly and reliably.
4 year old chip design on an equivalently old process node, not that unlike nvidia selling 2-3 year old chips as the spark. Thanks to AI boom, consumer market really just getting the warmed-over leftovers here from AMD and NVDIA.