pizza234
Joined 13 years ago
Joined 13 years ago
Excluding the modern equivalent of a script kiddie, even a "budget" attacker will have for sure invested enough to run a serious model (GLM 5.3 in this case, which requires hundreds of GB of RAM).
On the other hand - the defense - there is a large spectrum, and that's where the problem lies. There are surely companies that can defend themselves (either via cloud solution with granted cyber capabilities, or on local powerful machines), but there is a large amount of people that don't even know how to run a local LLM, let alone compile a program like Firefox.
It'd be simpler in the post to contrast, say, an "electronic" alien driven by AI, versus a syntethic machine, made by humans, with the same (hypothetical) AI; we'd istinctually recognize the former as intelligent/living, but not the latter.
The post is essentially retelling the carbon chauvinism concept.
So much for all the people stating (foolishly) that the HuggingFace incident was not a big deal because OpenAI's containment was a "wet paper bag". This misses the point: AIs will get better and better, and containment will be harder and harder.
It's 100% sure that at some point, AIs will attempt to cross airgaps.
The same applies to LLMs: we know how they produce language, but the underlying processes that enable it may themselves constitute a form of intelligence.
LLMs may learn from correlations and consistency, but that's separate from developing internal representations of what they believe is true, which is precisely what the paper provides evidence for.
"Believe" is of course not in the strictly human sense.
This level of understanding of LLMs may have been true a few years ago, but we're past far that. LLMs have solved a Millennium Prize problem, just in case.
Having emergent properties implies that an LLM has capabilities beyond the underlying mechanics (stochastic and the like), therefore to recognize emergent properties and at the same time to state that they are just regression machines is self-contradictory.
This is for example an interesting research, that investigates the existince of an internal state of truthfulness: https://aclanthology.org/2023.findings-emnlp.68.pdf. There's a lot of research on the higher level properties of LLMs.
See here: https://aclanthology.org/2023.findings-emnlp.68/ ("The Internal State of an LLM Knows When It’s Lying").
With the advent of agents, easy or hard doesn't matter much. One in thousands of agents will likely find a way, and that's what matters.
The related public challenge (https://github.com/KillaBoi/StealMyBitcoin-PoC) has been hacked after around 19 hours. It's up to debate whether it's really representative (at first it wasn't for sure, but it's been corrected), but shows that there has been an exploitable RCE pathway.
Well, anthropomorhizing is actually a fitting way of thinking AIs: they lie like humans do.
Problem is: there is a limited amount of apps that are genuinely fun and educative. If Amazon wanted really to do something truly educative for children, they'd build a whole market for it, the marketese I see in the article doesn't support that.
Regarding my kids: high priority, wide/curated choice (not in terms of restriction, but in terms of actively finding things they may like), accompanied learning, and, crucially, starting from a very young age. It's pretty much standard parenting, that is, one gets out what one puts in.
By the time children start to pressure for this type of devices (say, 10/12), they will have learned to enjoy books and more creative activities.
There are several reasons. The most important one is that children (ab)using highly stimulating devices don't learn to be absorbed by or find reward in less stimulating ones (most importantly, books). It's exactly the same risk as giving addictive drugs to adults.
This is not theory. Just look at children whose parents give them mobile phones/tablets as pacifiers - they become easily restless.
The intellectual argument is also important. Gamified learning is nice on paper, but one can imagine what children are actually going to play.
Related to another post: the difference between a child and an adult who plays videogames is that the latter has (hopefully!) learned "slow" skills, so they can choose pastimes like this deliberately.
Having said that, I'm for forbidding children from using this type of thing, but it's a very dangerous slippery slope, and there's lots to work on before that step.