someone travelling with a child or children I would have no objection in changing my seat.
But changing my seat because of someone's religious beliefs or his culture I would definitely say no to him