Comment

Comment by ALLTaken

It actually has vision + tool_use even the 27B param model. The community tries to produce even a MoE version of Qwen3.8 now, because that'd allow to run the full model with some experts being pruned like with Ornith 1.5 35B A3B.

You can get this to run on 24GB Ram: https://huggingface.co/baa-ai/Qwen3.8-27B-RAM-24GB-MLX

I found the FULL Qwen3.8-2.4T-A95B-MLX-reap50-3bit, but it's 540GB. So, I can't run it on my tiny laptop, but hope that the community finds ways to bring the size down and memory requirements too =)))

parent ALLTaken 2 months ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton