This phrase means that it is usually easier to ruin something than it is to build it. For example, it takes many steps and a lot of time and effort to build a house, but it could be destroyed in a much shorter amount of time and in fewer steps. This is true for other things as well, such as relationships, works of art, etc.