What a brilliant thread!! Funny, but a few of the ones I regret planting (or allowing to live) I am happy to plant in problem areas, for instance Lysimachia punctata (yellow garden loosestrife), which took over the front of my last garden, but I have now planted in shady, stony corner of my current front garden. It's great there, will brighten up that corner and I don't have to worry about it. I also know to start digging up any shoots that start to stray from it's allotted area.
Carex pendula (pendulous sedge) was a total thug in my last garden in the sun and I was forever pulling up the self-seeded offspring, and digging up the main plant itself was a nightmare. But in a shady bed on the other side of the house it gave much needed form and behaved itself. I'm thinking of planting in my shady border in my current back garden because it is magnificent when fully grown and it doesn't go mad in the shade.
Vinca Major variegata. Looks lovely, at first. Now I stamp on it if I see it!