If you haven't repotted this plant in a few years, could it have depleted the soil it's growing in? Flowers can expend a lot of energy and if you don't fertilize or refresh with a soil change once in awhile, they will eventually run out of some nutrient or another. Doesn't matter whether it's a daylily or a standard lily, though they may have different requirements