I'm one of those who has to race the bees (carpenter bees in my case, I believe) for the pollen.
They certainly love the yellow daylilies, but also the peachy polychrome ones too. In my garden, the first raided daylilies are the yellows and peaches, so long as they are in the sun. Daylilies (of any color) that get some amount of morning shade get raided later in the day.
We don't get many butterflies or moths here; those that we do, ignore the daylilies.
The hummingbirds will sometimes come to the daylilies. I think I read somewhere once that daylilies are considered an "alternate food source" for the hummers. Years ago, I gave some 'Quick Results' to one of my friends; she told me one morning that the hummingbirds were going after the blooms.