Comment

Comment by thoughtpeddler

For those running local models on macOS with Apple Silicon, how does Magnitude differ from what Apple's own first-party Core AI now does during its "specialization" procedure, wherein it performs some kind of "model optimization and conversion" (vis-a-vis AOT compilation) into a Core AI "compiled model" file that is optimized for Apple Silicon (leveraging custom Metal 4 kernels, or so Apple says), per WWDC labs from this year that discuss this? [0]

--

[0] https://developer.apple.com/videos/play/wwdc2026/326/

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton