As a white male who has dated Asian females in the past (and is currently in a relationship with a white woman, if you must know, and to ward off the inevitable charges of "yellow fever"), I find at least part of this sentiment highly irritating. I'm really not sorry at all for "taking" something from you that you don't "own" to begin with. They aren't "your" women and they can date whoever they want to. They're not "betraying" anyone in dating outside of their race. (I use quotes not to quote you but rather others who have made similar arguments).
This basic idea, that you can't even get the women you were entitled to by your birthright, is based on fundamentally flawed assumptions.
This basic idea, that you can't even get the women you were entitled to by your birthright, is based on fundamentally flawed assumptions.