mmmore

It's very hard for me to understand the frame a mind of the author of an article like this. I can't understand people seeing Anthropic's revenue go from $9B to $30B from January to April and seeing GPT 5.6(?) solve a longstanding open math problem and thinking that we've hit the top. I don't think superhuman intelligence that obsoletes humans is imminent, but it's clear that each model from OpenAI/Google/Anthropic is more useful than the last. They literally can't find enough GPUs to serve their customers; that's why the prices are so high. Apple, mentioned in the article, is now using cloud LLMs based on Gemini.

Local LLMs are awesome. Hopefully the way things go, in a few years everyone will have a local LLM that works for them, rather the bigcorp that made it. But it feels like cope to assert that cloud LLMs are dead.

Right now, the cloud-LLMs have big and IMO growing advantages. Cloud-LLMs are better at utilizing GPUs, economies of scale drive their serving cost down, they have the advantage in ability to monetize (like SaaS has the advantage over desktop apps), and they'll always have the most capable models. The question is whether the advantages of local LLMs in terms of personalization and data soveignity is worth it to consumers. And we saw what choice consumers made last time around, choosing centralized SaaS companies rather than a more distributed web.

This assumes that demand is elastic and unbounded. It might be true that there's a lot of untapped demand for software, but especially considering individual firms, it's plausible that demand for their offerings might be capped. In this case it does make sense for firms to shrink.

Analogously, automation and productivity improvements in farming drastically decreased employment in the farming sector, from basically everyone to basically no one.

Nope, Railway was the company who was hosting PocketOS, which is the company that blamed Cursor for deleting their prod database. Railway is only involved insofar as their API allowed an instant delete of the prod database.

I don't want to be a manager, but I also don't want to be a technician (for the most part). I want to be an engineer, which means my job is to solve problems. LLMs help me solve problems faster, so I use them.

Sometimes I get the urge to write code by hand and I do it, though. Less frequently, the LLM is inept at solving my problem, so I have to resort to the old fashioned way.

> If a human driver commits vehicular manslaughter, they get the book.

I wish this were true. Often they get off with a light punishment, or no punishment at all.

The token prices being high for Opus undermines your argument, because it shows people are willing to pay more for the model.

The thing is the new OpenAI/Anthropic models are noticeably better than open source. Open source is not unusable, but the frontier is definitely better and likely will remain so. With SWE time costing over $1/min, if a convo costs me $10 but saves me 10 minutes it's probably worth it. And with code, often the time saved by marginally better quality is significant.

One hidden premise of this is "AI tools are not useful now, even if they might be in the future." For example:

> Few are useful to me as they are now.

Except current AI tools are extremely useful and I think you're missing something if you don't see that. This is one of the main differences between LLMs and cryptocurrency; cryptocurrencies were the "next big thing", always promising more utility down the road. Whereas LLMs are already extremely useful; I'm using them to prototype software faster, Terrance Tao is using them to formalize proofs faster, my mom's using them to do administrative work faster.

Sure one of the companies paying for Linux desktop development is influencing what software gets development. Doesn't sound very nefarious to me.

Red Hat, Canonical, etc. want a working and friendly Linux desktop as much as you do. They've decided that Wayland is the best way forward for their companies and their users. It's not some massive conspiracy.

And they're not stopping you from using X, which is open source and still works fine for a lot of people.

I don't really understand what people who vocally object to Wayland are looking to change about the world. Do they want Wayland to be better? Do they want the developers working on Wayland to start working on X instead? The first desire seems reasonable by I don't get why it would inspire such ire toward Wayland. The second desire is unreasonable.

I've used Wayland (via sway) for multiple years including on machines with a 1060 and 5080 (mainly for good fractional scaling support). The only major issues I've had with it have to do with XWayland apps. I think there are some issues with providing a consistent experience with things like screen recording, 3rd party proprietary apps, etc. across different DEs/distros, but that's more of something that comes with the territory of Linux.

> I can't copy-paste, and I can't see window previews unless everything implements a specific extension to the core protocol

Sentences like this make me wonder how frequently the author has tried Wayland and what his specific setup is. I mean I understand experiences may vary, but I have such a different experience then him. I've had issues with Wayland, but I've also had issues with X.

> But the second actual users are forced to use it expect them to be frustrated!

Canonical and Red-Hat are not "forcing" you to use Wayland anymore than X only apps "forcing" me to use X (via-XWayland). They are switching to Wayland because they feel like they can provide a better experience to their users for easier with it. You're more than welcome to continue using X, and even throw a few commits its way sometime.

You can say that, and I might even agree, but many smart people disagree. Could you explain why you believe that? Have you read in detail the arguments of people who disagree with you?

Sure some of them maybe, but given that many concerned people think the chance of extinction is 10% or higher, it's not really low probability enough to be considered a Pascal's Wager.

I really don't think that very many people are concerned about AI because of Roko's Basilisk; that's more of a meme.

If you have not heard of one person worried about AIs taking over humanity, you're really not paying attention.

Geoff Hinton has been warning about that since he quit Google in 2019. Yoshua Bengio has talked about it, saying we should be concerned in the next 5-25 years. Multiple Congresspeople from both parties have mentioned the risk of "loss of control".

I think by most objective measures the size and power of large organizations has increased since WWII. For example, the size and scope of Western governments, consolidation in many industries, the portion of the stock market that is representated by the n-biggest companies, increased income/wealth inequality. If you debating the "large organizations have grown in power relative to small ones" part of the thesis I would be interested in what exactly you think would capture that.

> a zero-sum game

I don't see any reference to the game being zero-sum in Tao's words.

> Since when do these uncontrollable intangibles exhibit a genuine agency of their own?

I don't think Tao is saying the uncontrollable force of technological and economic advancement exhibits a genuine agency of its own. Just that our current technology and society and has expanded the role of the extremely large organization/power structures compared to other times in history. This is a bit of technological determinist argument, and of course there's many counter-arguments, but it at least has a broad base of support. And at the very least it's a little bit true; pre-agricultural the biggest human organizations were 50 person hunter-gatherer bands.

Honestly, I feel like you are filtering his words through your own worldview a bit, and his opinions might be less oppositional to your own than you might think.