As you are traveling with her, so the exit permit will be required for you only. Even if your wife is having permanent visa she will not required any exit permit.