so, your question isn't exactly "how to end the relationship", but it's "how to know WHEN to end the relationship", ya?
but you already know that it's not healthy, so the answer is in your question itself...