When you get tired of it.
when they start fabricating stories...
While thinking about it, you want to pull your hair out in clumps. That's the time to call it quits
When they get a restraining order against you?
Give them up if they don't make you happy