You can generalize intelligence to a lot of things. A* or minimax are algorithms that make intelligent decisions, often much better than a human. Consciousness is a very abstract notion, or maybe even a social construct, which we usually agree centers on human experiences, and progressively (not always, see historic religious scholars likening cats and dogs to automata lacking the free will granted to humans) expanded to animals, or generally all living things with complex enough brains.
LLMs are by their nature dissimilar from any biological organism. Biological intelligence evolved in bodies to locomote away from threats and towards food/mates, over time growing to model the physical world as it relates to these goals, and eventually becoming sophisticated enough we can manipulate entirely abstract objects, like algebraic terms, just as early homonids or crows could use physical tools.
LLMs by contrast are algorithms trained to mimic human language. Without extensive post-training and prompting, they would not have a concept of a self, and even with these they can still occasionally confuse roles in a conversation. They can't learn beyond the limited memory afforded by context, which tends to simply degrade the more you utilize it.
I suppose Q-Learning does demonstrate a more similar dynamic to nature, and you could draw parallels with RL on LLMs, but I still think it's categorically different from the entirely open-ended environment that is the natural world.
You could say what makes it valuable for us to empathize with octopuses, even though their brains have a fundamentally different structure from ours, is our shared experience of pain, and you could interpret negative rewards as a kind of painful stimuli. But at that point, you've opened up a whole can of worms that you can't close until reductio ad absurdum.
As for any human-like behaviors, I think the answer should be pretty obvious. It's an algorithm trained to generate text, of course with enough expressive ability, the optimizer will seek to model emotional utterances, assigning a speaker's general mood to some internal parameter. But as I've said, it would be a trap, even if you're very much not a stochastic parrot believer like say most Less Wrongers, to infer that just because it speaks like us it thinks remotely like us (see the whole Shoggoth meme).
LLMs are by their nature dissimilar from any biological organism. Biological intelligence evolved in bodies to locomote away from threats and towards food/mates, over time growing to model the physical world as it relates to these goals, and eventually becoming sophisticated enough we can manipulate entirely abstract objects, like algebraic terms, just as early homonids or crows could use physical tools.
LLMs by contrast are algorithms trained to mimic human language. Without extensive post-training and prompting, they would not have a concept of a self, and even with these they can still occasionally confuse roles in a conversation. They can't learn beyond the limited memory afforded by context, which tends to simply degrade the more you utilize it.
I suppose Q-Learning does demonstrate a more similar dynamic to nature, and you could draw parallels with RL on LLMs, but I still think it's categorically different from the entirely open-ended environment that is the natural world.
You could say what makes it valuable for us to empathize with octopuses, even though their brains have a fundamentally different structure from ours, is our shared experience of pain, and you could interpret negative rewards as a kind of painful stimuli. But at that point, you've opened up a whole can of worms that you can't close until reductio ad absurdum.
As for any human-like behaviors, I think the answer should be pretty obvious. It's an algorithm trained to generate text, of course with enough expressive ability, the optimizer will seek to model emotional utterances, assigning a speaker's general mood to some internal parameter. But as I've said, it would be a trap, even if you're very much not a stochastic parrot believer like say most Less Wrongers, to infer that just because it speaks like us it thinks remotely like us (see the whole Shoggoth meme).