bythreads
Joined 15 years ago
Joined 15 years ago
Qwen3-4B-Instruct-2507-4bit Qwen3.5-35B-A3B-4bit Qwen3.5-9B-MLX-4bit Qwen3-Reranker-0.6B-4bit Qwen3-Coder-30B-A3B-Instruct-4bit qwen2.5:0.5b
and the results are what i kinda expected to begin with, this adds next to nothing? - also the repo was pivoted from a playwright sub assembly to this not long ago - so my conclusion - THIS MIGHT be worth some watching if you have a model where no-one!, has optimized it at all - and where it does not use anything native to your platform.
results (averages)
VIA rapid-mlx :8902 (MLX) Decode: 175 tok/s TTFT: 64 ms prefill (~760 tok cold): 594 ms
Magnitude 0.2.1 (GGUF/llama.cpp+Rust) Decode: 161 tok/s TTFT: 111 ms prefill (~760 tok cold): 669 ms
I wish it was different but estetics, color sensitivity and for a lack of better word “taste” is a skill that needs training - the kerning alone on those make me sad - but the dirty secret is that meticulous design and craft is a dying breed - why spend days on designing whitespace when you can get something the client likes in 10 minutes from a prompt?
For the type interested - get this: https://amzn.eu/d/09z7Mut8
You’d change seperators and position if you truly wanted to do this right
Its basic date wrangling and tbh i see nothing malfeasant here
Its basically yyyy/mm/dd yy/M/d mm-dd-yyyy stuff but suuuuper lazily done