You are supposed to leave the country within 7 days after the cancellation of your RP and if you are still staying in, there is a possibility that the Search & Found Department will issue an arrest warrant and further consequences (Do you think that your Sponsor will let you stay here after cancelling the RP?)