My suggestion is you seek the assistance of family elders from your side who could coordinate with the family of your husband's side and together the elders could pacify the situation and help develop the understanding that is missing. In our part of the world this practice does help in solving issues such as this one. Don't take assistance from friends as this may offend him.
Pray to Allah that he soon returns to his own, real family life and gives the love his family yearns from him.