This quote means that when we look back in the future, we will not remember the negative things said to us by our enemies. But we will remember that our friends did not speak up and support us when we needed them to. This suggests that speaking up and taking sides is important, and that silence from either friends or enemies can have a significant impact.