Hi Kate, if the bees are bumblebees they could be endangered, so I wouldn't try and move them. It's unfortunate that they've moved in to your potato patch, but they'll be really beneficial to your crops in the long term, being on hand to pollinate flowers and increase your yields.
You could try to encourage them to move elsewhere by buying or making a bumblebee nest box, adding some cut grass and moss to it, and placing it nearby, under a hedge or alternative sheltered place.
You could also visit the Bumblebee Conservation Trust, which has plenty of advice on identifying bumblebees and encouraging them to visit your garden, as well as how to make a nesting box. I hope this helps, Kate.