Personally, I would never use garden soil in a container.
If you're growing a plant in a container, then that means the plant is a bit special to you, and that you intend giving it more care than most plants, so it deserves to have the best growing medium you can provide for it.
Personally, I prefer to use John Innes composts. They are not the cheapest, but are the best, IMO.
I do completely avoid any chemicals which are designed to be harmful, such as insecticides. But I don't have any issues about using general purpose fertilisers which are designed to feed plants, as they are completely safe.
Other members will have different views....