I think you and your husband should really sit down. You two should discuss what is happening. What is frightening him this much? Also think of ways to help him accomodate to the situation. After work, go out to somewhere quiet and discuss everything.