I think you've said it all - his spent compost will have few nutrients left, and he didn't feed them.
Your soil will (presumably) have some nutrients, plus you added farmyard manure.
Would he expect his children to grow and develop healthily if he didn't feed them? 