Oh that's quite interesting and hasn't been my experience with regular backend code specifically with respect to tool calling. However that could be because the tool calling format in vllm for Deepseek v4 was broken until a few days ago and that's how I'm running it.
I've been hearing amazing things about Flash, I should give it a try.
I've been hearing amazing things about Flash, I should give it a try.