I am not certain, but it would concern me. Others will have to comment further.
If it is a virus, do not dig them out, considering the promixity to the other lilies. You run the risk of leaving an infected piece behind or going through the roots of multiple plants, transferring the virus. It is better to poison the infected plants in situ and cover them to prevent insects feeding on the dying stems.
