Comment by 13hours

Anyone know if a MoE model that can run on a gpu with 16GB VRAM (like 3.6-35B-A3B) is in the pipeline as well, or only the dense 27B one?