I think this is probably a Rosemary beetle, which does munch on just the range of plants you mention, as do its larvae. If you google Rosemary beetle you can confirm (or not) the identification and recommended strategies. Shame, as it is pretty. But then, so are lily beetles...