tony_cannistra
Joined 9 years ago
Karma
1,904
Submissions
368
Member since
Aug 30
nature & software.
View on Hacker NewsJoined 9 years ago
In this post, we show how to run the latest frontier-class model — Muse Spark Open, with nearly a trillion parameters — right from your desk, using the latest version of MLX, released today. On a cluster of four Mac Studios, Muse Spark Open generates over 36 tokens per second (see Figure 1), well above average human reading speed. Beginning on a single Mac Studio (up to 512GB of unified memory), then scaling out across multiple Macs with the RDMA over Thunderbolt driver, below we share an overview of the range of models you can now run on Mac Studio.The path was added to OSM two years ago, which is after the analysis was done. OSM is a moving target!
With that said, folks who are pregnant are discouraged from using any retinoids out of an abundance of caution.