overgard

Slop.

People get mad when you call LLMs stochastic parrots. I just find it funny that people take insults towards a technology personally. But they could be bots.

People still get big mad if you call them stochastic parrots.

This makes zero sense to me. Like, ok, so you can install a low powered model on low powered hardware and do inference extremely slowly... to what end? Why would that be a useful attack at all? Assuming you've compromised this hardware wouldn't it make vastly more sense just to install regular malware? And like, in what sense would an 8B or whatever model be of any danger anyway? I've used local LLMs and 8B kind of sucks. Is it going to write bad poems on my TV or something?

Also, while I don't believe in the doomsday narrative.. hey maybe don't do things that are functionally useless but seems designed to create this doomsday in the first place? Like you can't say "oh we're so scared" and do stuff like this without completely losing your credibility.

I think their success is pretty debatable. This is a company that lost 8 billion dollars last year, is in an extremely expensive race with other companies, and is basically the premium version of something that's now becoming a commodity. They might be doing some impressive work but as a company their outlook seems questionable.

My thought too. Like, I get that Claude gets new features pretty frequently but.. what on earth are they possibly doing that needs that much churn?

The only thing I can think is that they're doing a google style mono-repo, which like, fine, that's a thing to do, but I really have trouble picturing that changing code at that rate is a useful thing to do.

I mean, I've mostly switched from Claude to Codex because I find the harness so buggy and annoying that I avoid it when I can. So.. as an (almost former) customer I don't think they're avoiding the issue at all.

I think your experience has been unusual. My experience with windows has been buggy patches that occasionally break my computer, bizarre and hard to track down performance issues, and features that I immediately want to not only disable but completely remove (anything copilot related, for instance)

It's also just plain disrespectful to users. For instance, having to hack the installer to allow for local user accounts, forcing edge on me constantly to the point where even when I change the default browser, things still load in edge, and it still reverts my settings on occassion. Using Windows actively makes me hate microsoft. I'm mostly just on Linux and Mac now, I only use Windows when I absolutely have to.

Linux does have annoying technical issues to fix on occasion, but I'm a lot more tolerant of them because I feel like the creators of it respect me and my rights, whereas Microsoft treats me like I'm renting my own computer.

Intuitively though at 40ish, most of the things I "learned" in school but never used have all fallen out of my head. The knowledge I have is things that I was actually excited to learn: computers, enough math to make computers do what I wanted, writing so I could socialize with other nerds better, history because I like history. Basically, you couldn't stop me from learning those things, but the things I was forced to learn ended up being somewhat of a waste of time for both me and the instructor, I think. I mean, you want to challenge kids a bit because they might resist something at first and then eventually realize they like it quite a bit (math for instance), but there's also a point where the tests mostly just become kayfabe. We say these people are doing "better" because they get a higher test score, but then they get into the real world where there is no test score, and that entire academic framework is kind of useless and maybe even harmful.

One thing that tends to get lost when we talk about the education system we have is how it was invented and what it was designed for. I mention this, because if you want to educate kids better, it's useful to consider what they system was designed for so we can design a better one. Unfortunately, the history here is somewhat more cynical and bleak than you might expect. There's an excellent book called "The Underground History Of American Education: A Schoolteacher's Intimate Investigation into the Problem of Modern Schooling"

Anyway, modern schooling was essentially designed to create excellent workers -- it was never about creating excellent individuals. At the time, the robber barons who helped invent this system along with a series of pseudo religious ideologues essentially wanted: standardized, predictable, obedient individuals without a lot of creativity. Credentials became important. Basically they wanted good consumers who don't question their station in life. (It shouldn't shock anyone that this is essentially what our current robber barons also want, although to a more extreme degree. It also shouldn't shock anyone that this is largely what we get out of the system.)

The current system was still helpful, despite it's design, I would argue mostly because of the excellent teachers that really do have kids best interests in heart. However, I really think technology has just completely broken this. I'm not sure it's a system that can be repaired, I think it's going to end up being a new system. My guess (I think it's basically already happening) is the rich will send their children to more experimental schools because they have the money, and the poor... well who cares about the poor anyway? (Sarcasm, but, I think that more or less describes the unspoken attitudes of the elites)

I appreciate this on a nerd level, but this just seems like a bad way to use an LLM. There are better artificial intelligence techniques for solving spatial problems.

In a way, I think they're doing us a favor with LLM slop: It's rare to have a signal that's 100% accurate at telling me it's safe to stop reading.

I don't get these model providers forcing people to use their (bad) software. I just downgraded my anthropic account because I can't stand the bugfest that is Claude. I won't even touch google for AI. Doesn't matter if your model is good if I have to use your software.

Claude has been creeping me out a lot recently when it comes to overstepping. Yesterday, I asked it for recommendations for software to scroll a video file frame by frame (I was debugging an issue in a game that only happened on one frame). I expected a list of software, what I actually got: Claude searched my documents and found my video file unprompted with no hint towards the name, then it searched my entire hard drive to find Krita, whch apparently has ffmpeg built in, then it used that to extract about 1000 jpegs of frames. All. Without. Asking. It was geniuinely creepy. It also ended up being useless, $45 of API spend later and I had a bunch of bloated and broken diagnostics code. I fed the same prompt into ChatGPT and it left my computer alone and told me to hit a checkbox in unreal engine, which was the actual problem. Really not a fan of Opus 5.