A doctor would never leave if he has an appointment, that's why there's a nurse and/or secretary to arrange the schedule.

There's always 3 sides of the story, "your" side, "his"(the doctor's) side AND the truth.

So, whatever it is, let's give this issue our benefit of the doubt...