Early May is a good time to cut back any woody perennials that need it, such as rosemary, rue, lavender, Santolina and Artemisia. If done before the danger of frost has passed, new growth may appear, and a freeze can kill that new growth and sometimes the entire plant.