I would say it has to do with one's principle in life. Whether a man loves his wife/family or not may/may not be the reason.