Hope you have great success with your Star Gazers.
Lilies love soft friable soil and orientals especially love acidic soil conditions, so I wouldn't put them anywhere near clay. I have good results with growing my lilies outdoors in pots in a mild (rainy) winter climate with some frosts.