IME, local models (so far) cannot do anything resembling "vibe coding" or what I call "high ambiguity prompting."
Ex:
Won't be good at it: "make a web app where you can download files with background jobs"
Much better at: "make a new dbmate migration to create a table with this schema, then write REST-style CRUD methods for it: [pseudocode table definition, you can gesture at types and indexes]"
So, they don't demo oneshots as well, but for actual "LLM-augmented software engineering tasks" they do super well.
Ex:
Won't be good at it: "make a web app where you can download files with background jobs"
Much better at: "make a new dbmate migration to create a table with this schema, then write REST-style CRUD methods for it: [pseudocode table definition, you can gesture at types and indexes]"
So, they don't demo oneshots as well, but for actual "LLM-augmented software engineering tasks" they do super well.