HI ,

No need , your visa is basically and or of your husband being the primary sponsor , in this case if your husband go you also have to go ...

enjoy