This quote means that ghosts are not typically hostile or frightening; instead, they are often with us because we are unwilling to let go of them. In other words, the presence of ghosts is our own doing, and we can choose to keep them around or let them go.