If you're not an Arab man, it may not be considered apropos - unlike the ladies, who can wear abayas without giving anyone offence.

If you are a white westerner, I would reconsider wearing it in public. You may certainly buy the clothing, that's not a problem for anyone.