I wonder if it is less to do with being fearful of women per se, and more to do with just being fearful of change. Do some men maybe see society as so fragile that and slight movement and a whole house of cards will come tumbling down?