I have a small city yard so this may not work for your set up.
The GH is about 1.5 feet from the fence so I can stain/maintain the fence
I have a dogwood shrub on the shady side (shade from the fence mostly) & my swing
I have tomatoes in a self watering box, similar to an "Earthbox"
I have container collections in the front. I do have landscape fabric under the gravel in the GH, under the container beds and in the bed with the dogwood. Basically under and all around the GH