Just book a ticket & on day of departure go to airport there is a Immigration Counter go there & cancel her RP, charges are around Qr.10/- etc . They will give you a receipt for cancellation. Keep the receipt incase you plan for going in for another maid.