Definitely Leycesteria formosa. It's a lovely plant but it can self-seed quite a bit, so watch out for plants where you don't want them. They're easy to remove when young, so not a great worry. The flowers are small and white and don't last all that long, but they're held in lovely dark red bracts that last for ages.
I can see a few dead bits in the pics - cut these out now while you can see them easily, then each spring (might not be needed next year) cut out the oldest stems at ground level. If they get too big, cut out more.
They lose their leaves in winter but the stems stay that lovely bright green, which looks really good. Happy growing!