ErrantX
Joined 18 years ago
Joined 18 years ago
The latest frontier models are producing significantly higher quality output. And the usual reason to introduce tech debt (deadlines) is less relevant.
Indeed, I know multiple companies fixing decades of bugs and security issues in just the last few months.
Prior to this, building the software was, generally, one of the main constraints. If the business wants to do X, then it takes 3 months to build.
That means the business ideation and governance cycle (what do we want to do, are there customers, what do we charge) can take 3 months.
If you 10x thay development process then you also have to do the same with the business processes.
Once engineering teams have cleared the backlog, then burned through the decades of tech debt the constraints will switch. And how businesses react to that will be interesting.
And even in 2024 the themes are similar, generally more complex or specific about the coding/turing/action test.
But in 2026 a huge shift, we have things like; can open a physical door, emulates human pettiness convincingly, makes novel scientific breakthroughs.
That alone tells you a lot IMO
Google never really has to outpace the competitors (other than to have some relevance) but they have a very large group of business customers using them for business process work in Gmail, Docs, etc.
Clearly they will win when the models are close enough to frontier to be good enough, but are long-term cheap for buy. I.e. they will aim to make it a commodity.
In theory MS has the same opportunity (plus they have GitHub so, you know, dev eco system too) but seem be blowing the strategy.
Anthropic and OpenAI are having to race to the top on ability entirely to keep their name in the media and in front of us all (which costs: hence more recently trying to pivot away from model releases and more into controversy/danger). The main cost is in training and so this strategy is much much more expensive and this will play out either as a huge cost hike or a forced slow down in pace.
I believe essentially Google is betting on that & I think it's probably the right strategy.
It was prescient (especially given he'd have written it through 2024) in its depiction of the ability of an AGI to break its boundaries.
Ultimately the risk of AI breakout(s) come down to the weakest human link.
Tech just happens and is useful, it's not necessarily attractive as a thing to investigate in detail.
And as to your last point; well that demonstrates your in the subset of people interested in this stuff. There are a hell of a lot of people very interested in trains too.
Big-co CEOs are naturally expected to share their bets - and they aren't going to couch it with a "oh well no one could know for sure but..", that would totally undermine their existence!
On top of that; sometimes just saying a thing can make it happen. So it's never not worth that shot...
This has always been true.
Your selecting a group of people (CEOs and VCs) who have always made and lost money on confidently predicting the future. See also wall street bankers and politicians.
There are winners and losers in any boom - this happened in Cloud, DotCom, computing and hell probably tractors, industrial revolution, etc
Fusillades specifically was unfamiliar but I inferred if from context and knowing fusilier.
I read a study a while ago (sorry Google didn't find it again) that said a lot of exceptionally gifted people just don't apply to elite universities. Instead, the main characteristic of applicants tends to be that they are extremely driven.
Drive tends to not correlate well to long term success without talent as a companion. Therefore a lot of people at Cambridge (which I think was the example) tend to do no better than the average in later life (notably wasn't true for PPE grads obviously)
Either due to corruption or, even more likely, institutional biases.
Malcolm Gladwell has a few episodes of revisionist history that looks at some US universities who fall into this trap.
Even with all that said; the chances of a selection process for 17/18 year olds being able to correctly select the best future adults in their field is very low.
Another good example; the number of young geniuses or prodigies (whether maths, chess, acting etc.) who don't make anything of themselves.
She remains my (close) second favourite[1], with a choose your own adventure talk about algorithms. It was genuinely great, and warm, and thoughtful (a lot of it was about the risks of algorithms, which is very relevant for us).
This was... 2021 so mid COVID (yep it was remote) and so just before she became really big. We've worked with a lot of external speakers since, many of them very good or very slick, but she was the only one that was clearly both brilliant at her topic(s) and also an exceptional communicator.
[1] For the record my favourite is Clifford Agius who is some guy I saw at a local conference who in his spare time from being a commercial pilot builds fully robotic arms for kids - he even lets them give the finger. Great guy and refused to charge us more than a few hundred quid.
What sufficiently hard, but useful, problem would you ask the model for?
The problem isn't the test, its that is a public test.
Simon has previously said he has a list of secret prompts (at least one of which he "burned" as a demonstration a while ago). That's what makes it a good test - his commentary on the public test is something of a proxy for non-public tests. This makes it a good benchmark.
So 3) he is well aware of his audience and is talking to them directly.
http://www.errant.me.uk/
http://twitter.com/errantx
http://www.errant.me.uk/blog/2009/10/pro-tip-tell-us-exactly-what-your-offering/
If you want to chat or comment or whatever I always welcome emails
[ my public key: https://keybase.io/errant; my proof: https://keybase.io/errant/sigs/m7EZLmQV9GiiOriXznJq8uH1p6RQ3t54rx1yRf4FdOs ]