Yes, the baby will be considered American. Depending on where the baby is born the baby can sometimes be granted dual-citizenship, but this is fairly rare from my understanding.