Try to identify what's what....maybe in couple of weeks or so....and hoe between plants or pot some up. Take your time ....it doesn't need to be done urgently or in one go. In future can you plant some less-inclined-to-seed perennials? Not sure lupins will seed that easily.....I expect someone will correct me on that. What about adding delphiniums, phlox, etc., which will occupy some of that space?