Models are tuned to give ethical responses and right-leaning responses are judged by RLHF process to be unethical. That's your problem.
It's not 'left' or 'right' to be ethical, but if one side is inherently antisocial and unethical then it's going to naturally create an appearance of bias toward the other.
It's not 'left' or 'right' to be ethical, but if one side is inherently antisocial and unethical then it's going to naturally create an appearance of bias toward the other.