No, being racist doesn't mean you have to apply the discrimination to every single member of that race. The act of stopping just 1 person doing something because of their race is an act of racism.