Comment Comment by simonw Runs fast on my Mac - ~100 tokens/second - but it's a bit of an over-thinker. It sketched out four different SVGs in the reasoning trace before returning a (bad) pelican riding a bicycle: https://tools.simonwillison.net/markdown-svg-renderer#url=ht...I used LM Studio and this model file: https://lmstudio.ai/models/nvidia/nemotron-3.5-lightningI got a pretty solid (and reasonably fast) result for this simply coding agent activity (with simonw/llm-coding-agent): llm code -m lmstudio/nvidia/nemotron-3.5-lightning \ 'how does auth work?' https://gist.github.com/simonw/a8741f79280cedc86bcb8d90edfb4... - took just under a minute. parent simonw 2 months ago
I used LM Studio and this model file: https://lmstudio.ai/models/nvidia/nemotron-3.5-lightning
I got a pretty solid (and reasonably fast) result for this simply coding agent activity (with simonw/llm-coding-agent):
https://gist.github.com/simonw/a8741f79280cedc86bcb8d90edfb4... - took just under a minute.