I am also seeing slower speeds, roughly the same ballpark, sometimes even lower - 10-11 tok/s on M5 Max. If there is that ONE version (GGUF or MLX) that runs roughly as fast as 3.6 used to run, please let me know.
What would be incredible is the 3.8 35B MoE version too, I can run 3.6 with 60 tok/s which is a really, really nice speed.
What would be incredible is the 3.8 35B MoE version too, I can run 3.6 with 60 tok/s which is a really, really nice speed.