I have just one daughter, and I feel terrible for being separated from her. I can only imagine how you feel about all of your children.

But there's another view:

Can you support them better than he can?

What is better for children themselves?

Is he good to them?

If he is, children will be happy, and that is all that any parent wants.

And with time the truth will float up.