It would probably be difficult but a start would be whether they are green, and according to this page kind of orangey at each end. I know the ones I saw on daylilies near here were not daylily aphids because they were black. Telling daylily aphids apart from some of the other green species that can affect daylilies would be more difficult.