The problem with this argument is that racists historically used every system in order to be racist. Should we eliminate public schools, because we still to this day provide less funding for schools in black neighborhoods? What about the Post Office, which was still segregated as recently as the 20th century? If we can't trust politicians not to implement policies in a racist fashion, don't we then have to eliminate the entire government?
Or we could strive not to implement good policies in a bad way.
Or we could strive not to implement good policies in a bad way.