axoltl
Joined 12 years ago
Karma
1,007
Submissions
179
Member since
Oct 15
Joined 12 years ago
Most exploitable memory corruption bugs are heap buffer overflows.
But if you're OK running it without a UI wrapper, mlx_lm==0.30.0 will serve you fine.
As far as Windows goes, https://www.loldrivers.io is a thing.
1: https://www.researchgate.net/publication/361238549_Consumer_...
So for data centers, training is just as important as inference.