It's truly worrying that the doctor has more concerns for their own holiday than the baby's (and yours) health. Please please please arrange for a 2nd opinion, you need to put your mind at rest either way. Best of luck.