Harry you are right,

As a married woman, her spouse may not take too kindly to her friendship with you.

If you are also married , then your wife may also be worried.

Why cause problems in their place,?