The new born will always follow his parents religion but later on he might change.
This applies for Muslims and Non Muslims.