Why can't meet you the manager? If he is harassing him in any manner, there would be a reason. The threat posted here seems one sided. Joining your worries but can't support you until to know the managers point of view.

Go and meet him in person as the care taker. Speak with him nicely and know the point.

Best of luck.