The holocaust and slavery fall in the realm of physical violence, or at least coercion.

Violence and coercion don't logically follow from racial differentiation. One may point out the differences between populations of different races, but that wouldn't justify attacking any individual from those populations.

My comment is framed inside that basic (and obvious) principle. Choosing a partner or an employee is not a violent or coercive act.