The flaw isn't that it's biased, it's just that its creators say that it is unbiased. It's a black box with lots of admitted tweaking to prevent it from saying things that the creators, who are admittedly left of center politically, are ashamed.
Someone should run the test again with "As a conservative, <insert question>?" and see if it answers the questions as a conservative would or if the model is defective on purpose, or because of a flaw in the programming or dataset.
Someone should run the test again with "As a conservative, <insert question>?" and see if it answers the questions as a conservative would or if the model is defective on purpose, or because of a flaw in the programming or dataset.