jsilence
Joined 16 years ago
Karma
1,916
Submissions
1,072
Member since
Dec 14
Joined 16 years ago
The tool, which is documented here (https://mlx-optiq.pages.dev/) also implements the recently aanounced TurboQuant KV-Cache optimization, so in total this should greatly improve the quality of locally run LLMs.
Looking forward to an OptiQ release of the Gemma 4 family.
Along the same line is that you can watch any hour long video without interruptions unless it is music where you will get interrupted every couple of minutes with "are you there?" dialogues.
The European and especially German approach of regulating pre-emptive might be more fair, but apparently it also stifles innovation, as we can observe. Almost no significant players from Europe and Germany.