Comment by jhrmnn

I think your last paragraph hints at the root cause. Many people simply have a trouble seeing gender purely as self-image since it has originated from sex, which is objective. And this development is quite recent.