Interesting question. I have always removed the dead foliage in my seedling beds and my perennial borders. The only place I leave this is in a big area of ditch lily. It has never held it back. Actually, come to think of it, I have a couple of older cultivars planted on a hillside, and they don't get the foliage cleaned off them, and it hasn't seemed to cause them any harm.
I will be interested to see what others have to say