I would stay away from it. Put a notice on the compost heap saying Wasp Nest - Stay Clear! and leave it well alone.
That's what the local garden centre did when a wasps' nest was found in a bag of compost on the edge of the car park near the farm shop - they put hazard tape around it too, Everyone went about their business and left it alone and the wasps left everyone alone. No one was bothered by it.
And that's in an area that gets hundreds of visitors every day (including small children who attend a 'play-gym' on site).
As Nutcutlet says, they'll all be dead soon and the queen will go off to hibernate.