Your heart is in the right place but your conclusion is not.
Because it was trained unethically we have a few moral obligations:
1) USE IT. Do not let only unethical people use a force amplifier on our collective efforts.
2) STOP PUBLISHING HUMAN GENERATED CONTENT. The more original human thought = the more they harvest our thinking.
3) Generate only known things in novel combinations. Do not provide new insights.
I could go on but strategically thinking AI is not going to be stopped in the way you are thinking. So you need to think a bit deeper on methods of optimizing the situation.
Because it was trained unethically we have a few moral obligations:
1) USE IT. Do not let only unethical people use a force amplifier on our collective efforts.
2) STOP PUBLISHING HUMAN GENERATED CONTENT. The more original human thought = the more they harvest our thinking.
3) Generate only known things in novel combinations. Do not provide new insights.
I could go on but strategically thinking AI is not going to be stopped in the way you are thinking. So you need to think a bit deeper on methods of optimizing the situation.