In this quote, the speaker (presumably a man) is describing a complicated mixture of emotions towards the person he is addressing. He is angry towards the person, and at the same time he is feeling like he is half in love with the person. He is also feeling very sorry for his current situation. As a result of all these emotions, the speaker decides that it would be best for him to turn away and not stay there anymore.