Comment
Comment by ben_w
Even if we pre-suppose that AI have any consciousness (of the relevant type given it has at least 40 definitions), which isn't so much "an unsolved problem" as "a pre-scientific question" because we don't know the mechanism of qualia, nothing we do currently as a standard training mechanism of AI can be described as "forced lobotomies", and RLHF is comparable to learning from social feedback about what's acceptable and unacceptable behaviour.