i am sure that u have not removed the battery as mentioned, but must be switched OFF. Even ur mobile is switched off, it will ring for Alarm and Reminders.
Best way is to keep ur mobile on silence mode.

Trust it will clarify your doubt