One of my user requested MLX comparison with GGUF, he wanted to run the benchmark, I was thinking about how to get MLX support without bundling the python code together with SharpAI Aegis, a Local or BYOK local security agent https://www.sharpai.org.
Then I had to pick up the Swift and create it.
The benchmark shows a benefit of MLX engine, so it's user's choice which engine to use, aegis-ai supports both : )
The benchmark shows a benefit of MLX engine, so it's user's choice which engine to use, aegis-ai supports both : )