Sounds like a temporary fence in warmer months would be a good idea if deer are coming in for lunch. I wonder if you could use temporary fencing - usually a mesh construction - and fasten it to the frame once the cover is rolled up. Might not be as obvious as metal fencing. Set a couple of chairs in there along with a table and dine al fresco...
