Thats a problem. If we can make a joke about a blond or a white the whites should be able to make a joke about the blacks and browns too without someone finding racial implications on the joke. But things doesn't work like that. Which means the world is full of racists and hypocrites too.
Half the time a white person will have a problem with a joke on blacks even if the joke isn't racial. He wants to be too much PC!