that moment in your life

Hey guys,
So who has had that one relationship when the person you love leaves? I'm pretty sure 99.9 % have. The other day a person who I have loved dearly who told me long ago that they had no more use of me and that I was nothing and had left came back. He told me he wished that he had never said those things and would want me to be in his life. That I was his greatest treasure in life. At first I didn't know what to say. Then I was angry then I calmed down and just thought about it. My reply was " there is a moment in your life when someone you love leaves and when they come back you realise you don't want them any more." Give me some feedback on this matter.