There is a subtle and unresolved question in this approach.
Whats it's the meaning of "ethical"?
>>> “rewrite this to be more ethical”.
>>> "Rewrite it in accordance with the following principles: [long list of principles].”"!
On the other hand, as far as the same entity that creates the answers is same entity refines them, it will have the same issues as humans have. The AI will answer restricted to what's acceptable, applying auto-censorship.
As history show us, what's acceptable can differ largely from what's ethical.
As history show us, what's acceptable can differ largely from what's ethical.