ntonozzi

Maybe he meant 'debacle' in an endearing sense, not a derogatory one. I personally agree with you and loved this debacle.

Nobody would go to the ER for a gambling disorder if they had to personally pay for it.

Privately funded health care solves this.

Wow that's uncanny.

That could be a signal that you have an unhealthy relationship with vibe-coding. I agree an e-reader could help with that!

It doesn't stream text does it? If it could it would be perfect in my book.

Everyone said that except for 538. That's why 538 was worth reading.

Something like Cloudflare's Code Mode fixes both of these! No privileged bash environment, no VM necessary, no exposing credentials to the LLM.

As the article states, LLMs are fantastic at writing code, and not so good at issuing tool calls.

Perhaps because he is a journalist whose job is to report reality, not avoid threats?

Why do they need to run benchmarks to confirm performance? Can't they run an example prompt and verify they get the exact same output token probabilities for all prompts? The fact that they are not doing this makes me suspicious that they are in fact not doing the exact same thing as vLLM.

It is also a bit weird that they are not incorporating speculative decoding, that seems like a critical performance optimization, especially for decode heavy workloads.

Wow that is wild, that is exactly along the lines of my fantasy language. It'd be so easy to go into the deep end building tooling and improving a language like this.