One of the reasons why so many people are recommending perennial lobelia (I have some myself) is that it is in flower just now. However, you really want a variety of plants that will flower in the Spring, and mid-Summer, and, possibly, in late Autumn.
I'd also echo figrat's comment, that perennial lobelia is particularly vulnerable to slugs, far more so than most other plants.
I was going to suggest a couple of lupins - they flower a lot earlier in the year, though they too are highly vulnerable to slugs.
Perhaps you could do with some more varieties of clematis, to flower at different times to the one you have.
I'm not sure why you're rulling out annuals. Even if you have perennials you'll still need to do some maintence.