You could but
I find a few snags with using garden soil in bags containers it is not so free draining- like a proprietary compost- and tends to set like concrete sometimes and you might set up a cosy breeding ground for some nasties
Having said that add some fertilizer and give it a go-see what happens