It sounds like you may be talking about this kind of daylily?
Daylily (Hemerocallis fulva)
Once they are finished for the season and the foliage is finished, it's perfectly normal that detrivores would get involved.
If your garden has no mulch and spent leaves and blooms are so fastidiously removed, detrivores are left with nothing else but to start munching on the "good" plants as they are fading for the season. Without a good layer of organic matter on the soil surface, soil improvement can not be as robust, and can only happen much more slowly if at all, and the microbiological processes severely hindered.
When I find a slug, I toss it into the grass.