No, Exist permit applies to you only and not to your family whom you are sponsored.

Therefore, you take an exit permit and you family + kids will not required any exist permit, they can travel any time.