Comment by h11h

There's a term for these entities that give every indication of being conscious but actually aren't conscious: philosophical zombie

https://en.wikipedia.org/wiki/Philosophical_zombie