This means that the speaker does not purposely try to look for or cause trouble. Instead, it is more likely that trouble will come to them without any effort from their part. It is often out of their hands and it is something that happens to them without them expecting it.