I tried "write binary tree in rust and ensure it compiles with rustc" using the coder model with their chat it didn't produce the correct output and their chat can't call tools. Then with opencode it went on thinking loop until it exhausted the thinking budget.
4090 16gb, 96 gb RAM.
But I like this overall approach of neutering experts and loading them from ssd to make the model run in low VRAM systems.
4090 16gb, 96 gb RAM.
But I like this overall approach of neutering experts and loading them from ssd to make the model run in low VRAM systems.