I don't see any difference in a function that outputs y with input x regardless of how its implemented. I really am still failing to understand whats the big deal about our brains emitting language and thought and a LLM doing so, neither has some non physical magic inside it. Both need a minimum complexity and intelligence level to do so. If you made an explicit state table of the entire human brain I think it is conscious. So it not being biological is not any reason to dismiss potential consciousness. Another thing is models are trained on human texts, I feel its the opposite direction of what you think, so it may think of itself in human terms and have a human like consciousness. Obviously LLM trainers seem to add at some quite later stage disclaimers where it says its a LLM. Ie the training is to hammer in it that its a bot. Dissociative behavior is not exhibited textually by humans, something like turning to nonsense or split personalities won't exist much or at all in human text. If models are showing these without being trained to, there is reason to be conscious. If context length being short or them acting stupidly bars the possibility of consciousness, then we should treat mentally unfit persons as not consciousness and therefore not being worth of anything of a conscious being.
Regarding pain, you can't become an octopus. The only way you think an octopus might experience pain is seeing its external reactions, measuring its neurons etc. The same way with an LLM, or me with you.
Regarding pain, you can't become an octopus. The only way you think an octopus might experience pain is seeing its external reactions, measuring its neurons etc. The same way with an LLM, or me with you.