Removing the infected foliage would be an extra layer of protection but daylily rust can't survive on dead daylily leaves in a form that can infect daylilies the following year, so if all your leaves normally die completely back in winter you should be safe in any case.
