OGWhales
Joined 7 years ago
Joined 7 years ago
You present this as something inherently true, but really there is no reason for this to be the case. We could make it so government entities are significantly more transparent than would be reasonable for a private entity. In practice, that is already the case and what you said really isn't true, though I'm always in favor of more transparency.
I don't know a single person that isn't aware of the issue, it's just a significant portion of them think it is outright fake or they just otherwise don't care because they see it as a lame thing to care about. How does one fix that side of things? It seems a major impediment to any progress.
Decimal floating-point is also hardware-supported, so it doesn’t carry the same computational overhead it does on platforms where it must be implemented in software.
They are not good at that. The space of possibilities can be massive and LLMs are terrible at exploring such space because they predict from the prior tokens they made. They are inherently bad at exploring new space because it is antithetical to how they work.
To me it's deeply concerning that so many people are getting fooled into thinking that LLMs are actually good at covering their bases like you're describing here. It's one of their weakest qualities.
> Analyze the different ways we can run this software, build a fuzzer, build property tests, and run this software in every scenario possible.
It usually does quite a bad job at this too, often the tests it wrote feel like that of a lazy student that didn't really want to do the task and just sort of cheats at it or does a really shallow job. It certainly cannot run the software in every scenario possible.
> Anyway all of this reads like someone who is not actually using LLMs to build software or hasn't tried them in a while
This is something that is said by everyone who contests anyone pointing out the risks in being overly trusting of AI or otherwise points out their flaws. I use the latest and greatest all the time and all the time I'll point out something that it totally overlooked and get hit with the classic "you're absolutely right". This occurs because I actually read the code and can see the myriad of blatant issues that still occur when using LLMs and know better than to trust them. You will find so many issue by delving into the details.
But yeah, comparing to codex/claude code was a bit silly since those can do way more. It’s closer to the chatGPT. I’m pretty sure 5.6 Luna, not sure exactly since it doesn’t specify Luna/Terra/Sol
Now, the "copilots" integrated in certain Microsoft products can be really horrible. I assume those are some sort of custom models that are not very capable, most of them I consider effectively worthless. But the web chat interface where I can pick chatGPT 5.6 seems fine...