Did the message say so or did you assume this due to the content? Cos for all you know the guy must wish to severe connections with you by his own freewill(or perhaps due to pressure from his wife) . Either ways this is obviously not a healthy friendship if it causes such tension, ill feelings, and threatens the harmony of another's marriage. Just cut him off and think no more about it.. You lose nothing after all, right?