" There's looking at a woman and thinking "Gosh she's good looking, I wouldn't mind having sex with her if she'd let me." and continuing on your way"

That's ok. That is a natural, respectful way for a man to react to seeing a pretty girl. He wouldn't MIND having sex with her (because it's natural for straight men to want to sleep with women) BUT only if she is interested to.