Lilies need lots of energy to grow. If they were small bulbs, they may need another year before putting out flowers. If you have the room to let them stay, I would let them grow and wait till next year to see if they flower.
Another thing that may cause this is that the bulbs were planted too deep.
good luck