Comment by smallmancontrov

On the contrary, you can feed the model counterfactuals and see what it does. Edit the person to be white then feed the image back into the model and see if its opinion changes.