I've controlled whitefly on indoor herbs in the past by filling a washing up bowl with cool but not cold water and a squirt of mild washing up liquid, then, placing my fingers over the top of the pot, turn the pot upside-down and swishing the herbs around in the water for a few mins, then turn the right way up and leave to drain. Doing this occasionally when the whitefly became visible kept them under control and didn't affect the eating quality of the herbs. Good luck.
No idea about the eggs though - could they be from something in the compost?