djoldman
Joined 14 years ago
Joined 14 years ago
and here is a direct link to the pdf without all the rigamarole:
https://www.microsoft.com/en-us/research/wp-content/uploads/...
That seems true.
But also: generate all you like and then have humans edit, and keep a record of it, seems plausibly defensible too.
The current state of a lot of AI generated content material, not all / not necessarily program code, seems to really benefit from human editing.
Much more likely to actually get to market is diamond as the heat dissipating substrate.
I like to check out everyone's first commits :)
Two reasons to question the 40% number:
- Anthropic probably represents the extreme case of AI adoption, if they're not the absolute leader. I would see 40% as the absolute max for that category without knowing anything else.
- Anthropic is a tech company, willing to change their workflows rapidly, having maximal enthusiasm for the technology, and maximum knowledge of it. The vast majority of the world's companies don't come close to it for these aspects and therefore adoption and speed should lag significantly compared to Anthropic.This seems to be a common and continuing objection to the OpenAI math repo release. Specifically that at least some, perhaps many of
* the natural language proofs are low quality or otherwise extremely difficult to understand (although possibly correct?)
* the lean proofs are too long, convoluted, or otherwise extremely difficult to understand
I wonder if LLMs will be able to generate "high quality" natural language and lean proofs soon.And specifically: iterate on the OpenAI repo to produce "better" proofs that prove the same things.
Commits per engineer 5.1x
Queries per data scientist 3.1×
Contracts per legal employee 3.1x
Deals per salesperson 1.7x
Hires per recruiter 1.4x
Invoices per AP processor 1.4x
These are the stats that might be hiding the possibly small potential for AI to generate "real" economic activity.The first 3 stats, commits+queries+contracts, are secondary/meta statistics that could possibly go up 1000x and have very little affect on Anthropic's business, whereas that's much less likely to be the case with the last 3.
AI can make it very easy to do more and more busywork that doesn't move the needle.
If the above is true, AI econ must rely on a second order effect here in that busywork/BS is recognized more quickly and discontinued.
For example, if an organization paid an employee to compile a monthly report and it took them a very long time. But with AI, they can make that report every day. Now the organization realizes that they don't even need it.
This may not be saying much at all. So much goes into deciding how fast to hire. Instagram had 13 employees / 1B rev at acquisition?
Also revenue per employee can vary a lot depending on the industry.
A better metric to understand AI effects might be revenue per employee at companies that have been around > 5 years that are AI-enthusiastic.
Anthropic (Claude models): Claude Code
OpenAI (GPT models): Codex
Google (Gemini models): Antigravity CLI
Meta (Muse models): Muse Code
> The CLIs' web search and web fetch tools are turned off, and the agent has no other internet access. The CLI is installed before the clock starts, and the hour counts from when the agent starts. There is no submit tool: the harness collects the bot when the time runs out.One thing we're learning is that harness is HUGE. The difference in performance for the same underlying model can change dramatically across:
1. harnesses
2. allowed tools (no web search/fetch - how does the model refer to documentation?)
3. thinking levels
https://arxiv.org/pdf/2610.12970
Shortest promoted paper I've seen from a FAANG.