I have buddlea mixed with weigela. What I actually have beneath is hardy geraniums. They make a good weed-free ground cover, tolerate the conditions, are useful to the bees, and very pretty in season.
I would have thought that plenty of other perennials would work too; maybe you have more choice if the small plants are beneath the sunny side.
As you'll know, weigela is a great plant for bees, early in the season.