academia_hack
Joined 6 years ago
Joined 6 years ago
Lobbying for a completely parallel regulatory framework to restrict who is allowed to run specific types of general purpose computer programs, just because we can imagine that some of those "general purposes" might be bad, feels a lot more like an attempt by capitalists to carve out a special kingdom over this specific technology for themselves.
For example, I'd be 100% in favor of holding anthropic criminally liable any time their AI enables someone to commit a crime. But I'm opposed to banning the export of GPUs above a certain size just because Dario doesn't trust what someone like me would do with them if he couldn't snoop on my conversations.
Super intelligence (the ability to have many smarter minds than your own reporting to you) has always been available to the wealthy and powerful. They used it to invent nuclear weapons, cause climate change, mechanize warfare, and pillage the global south.
Now that this same tool is on the cusp of being available to everyone, capital is starting to panic and throw up fences. They want to pump the breaks on a revolution they know they can't control. They see what they've done with super intelligence and (perhaps not unreasonably) fear what the masses will do with that same power.
This article explicitly asks for the US government to step in and push for further restrictions on model distillation, access to open frontier weights, and access to hardware. It also pushes heavily for independent auditors to monitor and control "AI companies" and for greater observation and control over of what people use AI models for and who provides them.
1) AI is a dangerous technology that can literally end the world.
2) Only me and a handful of other [people like me] should be trusted to determine who can use it and how.
3) The state must use its coercive power to support my control of this technology to the exclusion of [people not like me].
I think that EU-Inc _could_ be an improvement, but it needs to avoid the committee laundry list of ideas/requirements/form fields that plagues the EU startup ecosystem. My worry is that the end result will require notarized declarations of honour, financial plans stretching decades into the future, 30 page business plan documents, reams of corporate governance documents, and tons of other nonsense to protect against the perceived risk that someone who failed at starting a business once fails a second time.
There needs to be UX requirements on the process from day one against which the end result is judged. (E.g. "a company should be able to register in x days", "a complete application should be no longer than y pages", "application costs should be less than z euros").
Anecdotally, I find you can tell if someone worked at a big AI provider or a small AI startup by proposing an AI project like this:
" First we'll train a custom trillion parameter LLM for HTML generation. Then we'll use it to render our homepage to our 10 million daily visitors. "
The startup people will be like "this is a bad idea because you don't have enough GPUs for training that LLM" and the AI lab folks will be like "How do you intend to scale inference if you're not Google?"
It takes children a very very long time to learn a language and they're quite bad at it for many years. I've even met some teens/young adults who are only borderline literate in their native language after years of schooling and immersion.
As a result, there's zero chance even the sensible parts of this strategy won't just end up coopted into multi-billion dollar Palantir contracts to deliver outdated llama models behind some clunky UI with the word "ontology" plastered on every button.
That's not to say it's _much_ of a benefit, but if the only thing a job gives me is a market-rational amount of dollars and health benefits in exchange for life-hours, the invisible hand ensures I can find that virtually anywhere.
AI, doesn't feel all that different to the mechanical loom that was the impetus behind a lot of Marx's early critiques of industrial technology.
You've got a really cool invention that replaces what was previously a skilled artisan trade. The wealthy then use this invention to excoriate the artisans and render the loom operators as replaceable commodities.
Dario is essentially writing a blog post about why only he (and a few other approved elite companies) should be trusted to own the loom and then make it available for everyone else to labor at. Like the capitalists of Marx's era, he genuinely believes it is better for everyone to have this arrangement and that it is natural people like him should sit as benevolent gods at the top of the pyramid.
It's fascinating to me to see the same underlying mechanisms that gave birth to some of the greatest failed political and social experiments of the 20th century bubbling up again so clearly with AI today.