Got nuked on day zero by Qwen models at tenth or so of params.
Does not handle critical inputs even for moderation tasks
These guys did not even bother with an official huggingface space
And the biggest stupidity seems to be fixating on MXFP4 for Apple Silicon when it doesn't even have hardware support for it, should have just done Q4 for GGUF based inference
Does not handle critical inputs even for moderation tasks
These guys did not even bother with an official huggingface space
And the biggest stupidity seems to be fixating on MXFP4 for Apple Silicon when it doesn't even have hardware support for it, should have just done Q4 for GGUF based inference