Comment by grumpopotamus

We have absolutely no idea what makes something conscious or how to measure whether something is conscious or not. It is perfectly reasonable to consider that AGIs might have conscious experience, and to discuss the moral consequences of that. Some of the leading researchers including Geoffrey Hinton, and some of the leading philosophers of consciousness including David Chalmers have expressed openness to the idea that LLMs may have conscious experience.