Recent submissions

Comment · 1 month ago
AGI has been achieved. Now let's grow ad revenue.
Comment · 1 month ago
Would the marketing not land better when the model is actually publicly usable when officially announced?
Comment · 1 month ago
LLMs are a national security issue? Why is China releasing their models then?

The question is not whether you should have datacenters, or the most advanced chips, or the ability to build the most capacity. But do we need all this now? Will there be enough demand? People want to make profits form this thing, and what's being pointed out is that maybe there won't be enough demand to generate profits for all this investment.

Comment · 1 month ago
I think when cornered, he does say it works for coding and some other tasks. But to be honest it also makes a lot of bugs when writing code.

I don't agree with everything he thinks, but I think I agree with him more than I do Sam Altman or Jensen.

Comment · 1 month ago
Things in general I think he's right about:

1. Revenue if anthropic and openai is unlikely to grow to the high levels they need to pay for their commitments. Many of their heavy users (coding) will eventually offset a lot of usage to more efficient and cheaper open weight models. I know of people in a company I was at that spend thousands of dollars a month on tokens. I am sure that what they're using it for can be substituted in large part by way cheaper models.

2. A lot of corporate AI usage is being pushed by management that doesn't really understand the extent of its useful, and just wants to call themselves an AI-first company.

3. If this datacenter build-out proves to be beyond the actual demand, there might be a big economic crisis as to how much of the financial system is getting tied up with it (insurance money, private credit).

Whether openai and anthropic actually die, I'm not sure. But I don't think they'll be the next big tech companies. I think eventually they'll be absorbed by others.

The whole thing I think, can be summarized as: LLMs will be commodity like. And it's price will go down and eventually will run locally, it's not at all clear that this will bring AGI and that it's worth infinite amount (or trillions) of investment ahead of the actual demand or the AGI level do-it-all-for-you AI being reached.

Comment · 2 months ago
Will we need all the data centers being built or will improvements in software and hardware allow the majority of AI workloads to run locally or in the cloud but way more efficiently than was projected when all the plans were laid out?

Like were executive at Google and AWS and Microsoft expecting this kind of performance from models smaller than what openai/anthropic have been doing? Are we really in a "compute desert"?

Comment · 2 months ago
If things like this get traction, will we need all the datacenters?
Comment · 3 months ago
The 1000 TPS shows for me as "SWE 1.7 Lightning" and took 14% of my daily quota in one prompt on the $20 plan.

But the normal speed one seems to be free or with very generous limits.

Comment · 3 months ago
Its crazy that OpenAI and Anthropic themselves aren't doing that. No attempts at reducing inference cost for code as far as I know from them.
Comment · 3 months ago
We need more models that optimize for coding and that can be cheaper than frontier models, like what SWE 1.7 and composer 2.5 are trying to do. I don't think there's an effort to make something GLM-5.2 level but focused only on coding.
Comment · 3 months ago
They blocked gambling ads from in stadium ads for the world cup, but Kalshi was still able to get one in because it's "predictions" and not gambling.
Comment · 4 months ago
The article from archive you link.. scores as mostly human on GPTZero (I tested a random paragraph). That's the issue I've always seen with AI detectors, they might be able to detect direct LLM output, but if you give an article to an AI and tell it write something made up using that format and make it appear like a real story, the detectors will think its real.
Comment · 4 months ago
I really hope that in a couple of years I can have a laptop that runs a reasonably good coding agent locally, that I can run fast and do most of my programming with, without running my laptop hot. I could keep open code and use other models when needed, but really for most of my work, I'm already breaking it down so that I can review code changes eventually, and I just need something reasonably decent and fast and unlimited. I think its coming.
Comment · 4 months ago
Use LM Studio.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton