This quote is saying that it is not the amount of money or material possessions that we have, but rather it is the things that we are willing and choose to give up (like money, possessions, opinions, feelings, habits, etc.) that contributes to our real wealth and richness. Taking up more and more things only leads to more and more stress. However, when we practice generosity and sacrifice by giving up, then we reap true richness.