A real man/woman is one who is able resist temptations...you are a loyal and loving husband. What you did is 100% right. May be some people may disagree. Avoid such situations in future....make yourself clear to your so called friend.