Recent submissions

Comment · 3 days ago
Is this just giving a general-purpose agent a workspace full of documents and an assignment, then seeing what happens? I feel this doesn't really say anything. It appears they mostly dumped all of this in base models with little to nothing in the way of infrastructure to support it. If you just randomly grab some person off the street and say 'do taxes' they would probably mess up just as badly. The interesting question would be what the models could do in a well engineered harness focused on taxes. That would be reflective of the performance boundary and how serious we would have to take AI in that field.
Comment · 8 days ago
There is a natural limit to the size of a corporation (it's big) before the inefficiencies of size start to choke out your ability to get anything done, and AI doesn't fully fix that. You can't do an arbitrarily large number of things and expect to keep running as a business, this is why even large firms today tend to break into separate companies (a lot of the large companies you can think of actually run as multiple smaller companies under one umbrella). Even when AI is 'as smart as us' it's not going to remove this limitation (might lessen it)... see irreducible complexity, diseconomies of scale, etc...
Comment · 16 days ago
The claims seem to be an overreach of what is actually proven. We've known about progressive feature complexity and the impacts of early training structures on later training for a really long time (since CNN's, The Lottery Ticket Hypothesis, etc...) and neither of those phenomenon are mutually exclusive with parameter overloading. The Multimodal Gap work (https://arxiv.org/abs/2203.02053) seems to imply networks have a tendency towards condensed representations that are clearly not semantic and a bunch of other considerations are already on the table for discussion. I don't think these have all been considered sufficiently to start claiming we are around the corner from mechanistic interpretation.
Comment · 18 days ago
Anyone else feel ripped off? There are solar systems with 6 possible Earth like planets and others with Super Earth Garden Worlds and what do we get? One measly mediocre Earth with our nearest neighbors being a poisonous rock and boiling ball of acid.
Comment · 29 days ago
But I can probably prompt Claude better than your customers too, so can at least 50 of the people I know (advantage of a tech heavy social circle). Good luck turning your prompt into a business when me and 50 of my friends can replicate your business model in about 10 second. Don't believe? Go ask Jev devs how they feel about Clef.
Comment · 1 month ago
"I have in mind something like a “deployable intellectual reserve”: communities of mathematically sophisticated people that humanity can call upon to help understand consequential AI-enabled breakthroughs. " -- I can't be the only one who thought about the scene where the scientists ask Deep Thought the ultimate question...
Comment · 1 month ago
Can we all agree to ban the term 'non-autoregressive model' from our collective vocabulary? It's like naming a database a 'non-spreadsheet'. Decision models, direct inferenceing models, etc... there are sooo many better names for this. I would have thought we had learned our lesson with the whole 'Vectorless RAG' incident. We should go back and check what they named the Gorilla models at Berkley.
Comment · 1 month ago
It took us a few hours to implement that one we used in 2022. This isn't about usability its about a huge population working on this stuff not really knowing what is available until it becomes a meme.
Comment · 1 month ago
"I don't see much substance to this buzz..."

Agreed. This isn't new. I led a research team at a Fortune 500 that used a transformer based classifier approach in a commercial product as far back as 2022 and we didn't come up with it. It was already common enough that we found the inspiration for our implementation on some web forum. Models like RouteLLM have been around for a long time. The news here isn't that a new model type came about, its that a large percentage of people messing around with this stuff that are new to AI just learned that not all transformer based implementations need to be autoregressive.

Comment · 1 month ago
I really like this game and have played it for years but I think it's popularity outgrew it's niche. It's a very niche game, the devs have made the ultimate space Lego kit, but I see lots of people complain about it being boring because there are no stakes, no challenge. I think they are trying to play the game they want it to be not the game it is. The overwhelming scale of the meme this game has become I think is the cause of that.
Comment · 1 month ago
I don't see not having AI as a feature, but I'd prefer for them to take the approach of optional, easy to implement interfaces that increase the ability for the suite to be 'scripted' rather than implement AI directly. My motivation is that the field of AI is moving so fast I think its a better long term plan to make your software something that can be automated with AI than to try to fight the speed of that innovation curve. I get that even that can be difficult because of security concerns, but it seems more straightforward than implementing models directly into your application.
Comment · 1 month ago
I am sure it will be fantastic for the whole 6 seconds before it blows my weekly usage cap.
Comment · 1 month ago
In this case, the fully open source pipeline is probably as valuable or more so than the weights, so releasing early has some justification.
Comment · 1 month ago
I know I am in the overwhelming minority and that most people will just continue to buy Sony's stuff anyway, but I decided a few years ago when all the ownership crap came up that I am just not buying stuff that I don't own. Sony's PS4 went to my local electronics recycler and I haven't bought a Sony product since. I can't realistically do it with everything, there are some products I have to buy rather I get to own them or not. But I am not putting up with it where I can and gaming is optional -- plus GOG has served me really well since.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton