Liberal use of black garden fabric, covered by bark should do the trick. Wood shavings, if you have a sawmill nearby - cheaper, maybe even free. It will look silver next year. For creeping grass, I would also consider sinking a flexible plastic weed barrier at the outside edge.
Pretty exciting, starting a whole garden from scratch!
