Not all potatoes flower, so that's not always a reliable guide. I agree, you could scrape away a little of the compost to see if you can find any of a suitable size....it's even got a name with the old gardeners...it's called a broggle or broggling.
It's worth noting that it takes between 10 &12 weeks for earlies to grow from planting to harvesting.