As CYman said, the most important thing is not to show any sign of weakness, he'll immediately take advantage of that. Show him that ur strong, confident and that he's not affecting ur life in any way. Take control of the upper hand.

I've never been such a situation, but I think all the above advice makes alot of sense...so go for it! But I do know confidence and attitude are the key. So be strong girl!