Got any bulldog clips, Lin? That's what I use - you can get a package of 20 from the office supply store for about $3. The medium size ones are big enough to clip a cover to a plant stem very nicely without crushing the stem.
Alternative is search out some heavy weights or rocks, and just weight down the corners of the cover on the windward side. Clay pots work great!