I use pruning shears to cut off the dead stalks from the previous year. I am always afraid that if I get to pull them out that I might damage the peony tubers.
Here is a link to the peony page on this site. It has a little more info.
The Peonies Database