For many of us it is due to the expansion out of africa into different climates. Evolution works but it does not work that fast, so we took a short cut.

And yes there are still some tribes that have their private parts dangling out, if that is your thing.