Comment Comment by andrewmunsell Another data point:17.6 tokens/s on an M4 Max 40 core GPU parent andrewmunsell 1 year ago
17.6 tokens/s on an M4 Max 40 core GPU