my dear, applying the resident visa is nowadays very hard to get the approval depending on ur nationality. if u have it already, better not to cancel it. coz once u cancelled it, u've to suffer a lot even if u get the approval again.
what is that serious problem if ur baby is 2months old, he/she can travel.
my suggestion for u to bring ur family back before u expire there visa.
regards,
khalid