Lwrless
Joined 11 years ago
Karma
2,056
Submissions
271
Member since
Dec 14
Joined 11 years ago
With larger (also really fast) unified memory on the chip, it could easily load larger weights, and the thing is that the quantized results on the M5s are really good, I believe that for most local inferencing, users would be using INT4 (maybe more bits per weight sometimes) quantized models, that might be where the Neural Accelerators kick in. In raw power, a desktop 5090 easily outperforms the M5 Max, but for this specific use case, I believe that the M5 Max is good enough.
So is this performance gain probably due to the new Neural Accelerators?
I do find it sometimes hard to navigate and has some visual glitches, but man it is good. I hope one day it becomes my go-to for space exploring, since Space Engine is Windows only and it does not run on my Mac. And building the space must be a huge amount of work, there's so much that has to go into it.