I seem to remember reading somewher that cornus kousa is not self fertile so you may get better fruit production of you can grow another one nearby. If you haven't the space, then settle for what you get as the fruits are not edible and the foliage and flowering bracts are the main attraction of these plants.
They are also insect pollinated so try growing other plants with nectar rich flowers to attract them.