It is possible and in this case you'll have to pay him back what he paid you as dowry.

He might be given the chance to 'demand' something else but it's unfair. Prophet Muhammed didn't do that yet some would say the husband can demand whatever he wants not only the dowry. Crooked practice!!