peab

Looks like the paper is from 2025?

I think the problem with these sorts of studies is that the industry is moving so fast, and by the time your paper gets peer reviewed and published it is no longer relevant.

In this paper, the participants are using mostly ChatGPT - well, there's a HUGE difference in free chatGPT, gpt 6, gpt 4o, gpt 3.5?

What might have been the case for say, GPT 4, is probably no longer the case with GPT 6.

My experience with Google's gemini right now makes this obvious, as I run out of Gemini 4 Astra in a conversation, and then it switches me to Gemini flash lite.

I don't think this is the case anymore if you're using the latest expensive models, i.e fable.

most large software companies are already too large for anyone to have a complete mental model of.

The idea that someone at say, Google, will be able to fit even half of the system architecture in their heads is not realistic. It also hinges on being able to find and understand the right slice of the system in any situation.

But we have all sorts of guardrails to make that easy - i.e logs, traces, etc

TIL, thank you

TIL

Yeah that's fair. I'm being overreactive, and I do believe it has it's use cases. I was more referring to all the demos and takes I saw when it first came out that were hyping it up as if it was more impactful than Astra or Fable or whatever - which turned out to be a paid marketing campaign.

Ok, every time I hear about Jev I get annoyed.

The ability to have decision making models is not new! Look at qwen, gemma, etc, they can all do structured output, and they can do it locally and cheaper and/or faster than Jev!

What really pissed me off was that y'all got manipulated into thinking it was something revolutionary, while really it was a marketing stunt.

Go to doomers.ai and look at the case studies.

the only thing novel about Jev is the incredible PR/Marketing push that they achieved

Yeah, I'm with you.

Nowadays any LLM and any harness you use will just do this for you.

But there are helper libraries like Instructor that have been around since like gpt3, which abstract away retries and stuff to make this super easy.

Ah yes - a company is such a failure that it recently raised 3 billion dollars at a 23 billion dollar valuation?

If it's successful, their boring machine will tunnel 10x faster and 10x cheaper than competitors, and it will be the one making new tunnels for all sorts of trains.

The craziest part about FSD is that people still think it doesn't work.

The fact that you can pay the average price for a car, and get a car that fully drives itself today, is mind boggling.

FSD is on the path of being incredibly successful. You really have to try it, if you haven't already.

Boring Company is also on the path to being successful, it's just not advertised much.

Solar roof - yes, this one I would mark as a failure.

Cybertruck - they're still selling, so not a failure. But not as great as originally promised.

Hyperloop - this could still come after boring company succeeds.

Nobody is saying he's god. But maybe, he understands engineering better than some commenters on HN, that's all.

I'm sure you also thought falcon was going to fail, Tesla would never work out, and Twitter would collapse after Elon bought it.

Wow that's awesome