You will find that non-European immigrants, especially from Commonwealth and ex-Commonwealth countries, also have a negative opinion of the previous preferential EU immigration rules. I have met many South African and Nigerian immigrants who found the disparity between their right to immigrate and that of EU citizens deeply unfair, and many who were eligible to vote in the Brexit referrendum chose to leave the EU for precicely that reason. They can hardly be accused of racism.
Besides which, the conflation of a desire for immigration control with racism is a lazy canard.
Besides which, the conflation of a desire for immigration control with racism is a lazy canard.