kevinlu1248

Ya definitely, that makes total sense. It feels to me that currently the labs have great researchers, who only care about making models perform better across raw intel and then they have incompetent applied AI engineers / FDE's who can only suggest using better prompting to remove bad habits to make agents more usable.

It's a bit undertrained on C#, we'll continue improving on this!

Also wish Fleet took off, not a fan of installing a new IDE for every separate repo that's in a different language

I've done some testing before and many of the new Jetbrains internal plugins cause memory leaks which really lags down my IDE...

Definitely agree here, have had so many cases where I would like ask Claude for XYZ, then ask for XYZ again but with a small change. Instead of abstracting out the common code it would just duplicate the code with the small change.

We currently integrate with Jetbrains' PSI

Honestly I think we can improve our training throughput drastically via a few more optimizations but we've been spending most of our time on model quality improvements instead.

You can see that Qwen3 does worse than Qwen2.5 on our benchmark. Reason is it's never been pretrained for FIM / autocomplete.

Not at the moment but we do host it for our Jetbrains plugin

Yes, I've used it to write blog posts / large user-facing copy.

^ these were pretty much the main reasons.

The other one is that constrained decoding only works on CFGs (simpler grammars like JSON schemas) since only these ones can produce automatas which can be used for constrained decoding. Programming languages like Python and C++ aren't CFGs so it doesn't work.

Also constrained decoding generally worsens model quality since the model would be generating off-policy. So RL helps push corrected syntax back on-policy.

Unfortunately, the main optimization (3x speedup) is using n-gram spec dec which doesn't run on CPUs. But I believe it works on Metal at least.

Haha, we never trained it for chat but I would bet it works regardless.

Also that's crazy, M4 Mac?