gymbeaux

My understanding is both USB 4 and TB use PCIe tunneling. Surely at this price point we’re looking at a USB 4 device. Thunderbolt has historically cost more due to licensing, which is now free I believe, but there’s still specialized hardware and requirements manufacturers need to adhere to.

It’s an incredibly dumb implementation and it feels like yet another case of “AI startup gettin’ while the gettin’s good”. It’s the dotcom bubble all over again. Do anything with AI and people will buy what you’re selling.

The RX 9060 has a TDP of 160W, but that’s the high end of what you can continuously draw from the 12v DC plug in a car, so it looks like they cap it at 100W. It has to be on the floor or under the passenger seat because it has to plug into that 12v outlet that’s usually in the front.

Things will get caught by the fan blades, and passengers will inadvertently kick it. Hopefully suddenly losing connection to the GPU won’t cause the car to hit a pedestrian or anything like that.

What would happen to Nvidia, Anthropic, OpenAI, if tomorrow someone released an open weights model on HuggingFace that matched performance and accuracy of Opus 5 running locally on an RTX 5070? That won’t happen tomorrow, but it will likely happen someday… what’s the plan beyond “don’t be the one holding the bags?”

We’re in the phase of society where we will just build something like this ourselves using an LLM and it will be built exactly how we want it and we don’t have to worry about malicious code or forking it and hoping the owner will merge our PR… it’s sad but that’s where we are for anything the size of a menu bar that pings a URL every minute.

But they’re slower (and benchmark worse) than Opus, GPT, et al. Why?

Kimi and DeepSeek are impressive for their size but still run slow on any hardware you or I would have. If you’re proposing we run those via a cloud service, I don’t see a reason to do that when it’s an inferior model and I still have to pay per token for it.

When I see new software now, my first thought is an LLM wrote it and it makes me not want to use it. I also assume there are bugs and it’s not particularly feature-rich.

I look at all the “role model” esque people in my life - they’ve all been fired from a job at least once. There are also plenty of people I know who I wouldn’t consider role model esque who are simply lousy employees (and probably get fired many more times than the “role model” types). I say role model types simply to mean “people who you would be surprised to learn were fired from their job”.

Stigma meaning others judging you for being fired. High level “no one” wants to hire someone who was fired from their last job. I’m just saying in my experience everyone gets fired sooner or later, regardless of their abilities, job performance, social skills, et. Al.

LLMs are incredibly inefficient and can never be “100% accurate” so we have effectively seen what they can and can’t do already. If LLMs haven’t taken your job by now, they aren’t taking your job.

Everyone who could be considered a role model in my life has been “laid off” (fired) at least once. These are successful people. They’re all millionaires (not just the retired ones). We need to get over the fear and stigma of getting fired. It means nothing except your boss didn’t like you.

But what if all your coworkers are doing it, so by taking the time to understand and review LLM output you’re painting a target on your back? Anyway I’m not getting burned- the company is.

This made me think of how we have to manually block certain devices (usually smart TVs) so they don’t “phone home” and show us ads and so forth. I see your switch being banned as a sort of mixed blessing. It’s liberating in a way. I wonder if there’s some way to use a proxy to self host the software patches. We had something similar on the PS3 homebrew scene.

I often use LLMs to build locally running web apps and console apps that I otherwise never would have built, because the value-add wouldn’t be worth, say, 40 hours of my free time.

I just sold an RTX 3090 (released in 2020) for $1000. It should have been more like $200. I don’t see a point in running local LLMs with it but plenty of other people disagree, or want to “play around”. It’s so old that I can’t imagine a scenario where I’d be glad to have it- even if local LLMs ultimately catch up to the cloud frontier models (Opus, et al.). In a world where I can run Claude Opus 4.8 on an RTX 3090 at reasonable speeds, Anthropic doesn’t need even 1/20th the GPUs it has and it will dump them on the secondary market.