Comment by johndear223

There are solutions already for Mac , check out ISTA DAs lab hugginface, I got one of their qwen next models working pretty fast on m2 ultra