This quote means that the person is mischievous and behaves in an inappropriate way. They do things that are considered wrong or inappropriate, such as kicking kittens and insulting nuns. It implies that they take pleasure in doing wrong or rude things.