Your Q: Would you justify a man having extramarital relation just because his religion don’t permit him to marry again?

A: In above case, it is not at all justified and unacceptable. It is purely cheating/infidelity with many people at once, ignoring personal, moral and social responsibilities.

Please note that there are many more reasons for remarrying to widowers or divorces...