If you live in a country where your race is privileged over another, you benefit even if you don't have racist views yourself. This point has been made by the Black Lives Matter movement.
You could have been the nicest white person in apartheid South Africa but you benefitted by living in a country built on cheap black labour. And people were not innocents fifty years ago, with no concept of right and wrong. How could you live under apartheid and not know that black people were paid less, had inferior education, inferior health care, inferior housing, less opportunities, separation from their families, restricted freedom and were treated without respect? Or that those who protested were arrested, beaten, tortured or killed? Knowing these things, you knew you were living in an immoral society and closed your eyes to it, or you believed that it was right for whites to rule blacks, or you left or you became a freedom fighter.
To be honest, I think that people who emigrated to apartheid South Africa are more morally culpable than those born there. They saw, from outside, what was happening and they went to join in.