That's the (hard) problem of qualia. You can't say for sure that ChatGPT doesn't experience anything. And I can't say for sure that you do, either. It's trivial to dismiss it on the basis of "well obviously it's like that"—far more difficult is to say something about why it's not like that.
I think consciousness has to be the product of an algorithmic process. I think this process can be summed up as "prediction". I don't think there's some secret quantum/soul/magic aspect to it. Which is why I think it's plausible that transformer models may capture some aspect of what we refer to as consciousness, though I don't quite buy it at a gut level.
You say that "it's not even comparable to the experience of a simple invertebrate," but that's just you writing down what your gut is telling you. What is the experience of a simple invertebrate like, exactly?
I think consciousness has to be the product of an algorithmic process. I think this process can be summed up as "prediction". I don't think there's some secret quantum/soul/magic aspect to it. Which is why I think it's plausible that transformer models may capture some aspect of what we refer to as consciousness, though I don't quite buy it at a gut level.
You say that "it's not even comparable to the experience of a simple invertebrate," but that's just you writing down what your gut is telling you. What is the experience of a simple invertebrate like, exactly?