He must have known I'd want to leave you.""No, he must have known you would always want to come back.

This quote is suggesting that the speaker’s partner knew that the speaker might want to leave them, but believed that the speaker would eventually come back after leaving. The speaker’s partner has faith that their relationship is strong enough to overcome any hard times or challenges they face together.