This quote means that if everything else in the universe vanished, and only one person remained, they would still be important to the speaker. Likewise, if everything else stayed the same but that one person were to disappear, the universe would feel like a totally different and unfamiliar place to the speaker.