Yes, it is Celandine, and as Sue8 says, it is very difficult to get rid off. It can be dug out, but the roots sometimes go up to 8" deep. You must get all the little root 'nodules' out or new plants will grow. Little and often to try to eradicate it is the answer, whenever you see it dig it out thoroughly. You could try spraying with Glyphosate with a little washing up liquid added, if that's practical, as this will help it stick to the very glossy leaves better. Make sure you don't spray any plants you want to keep. Sadly I can sympathise with you as I seem to have imported it into my new garden, I suspect, in Council compost!