You can not generalize. Some married men might not wander even if a lady is imposing herself on them.