Probably the daylily on the left, and even more so the whateveritis growing up the fence behind it, are more competitive than the lavender. It looks like quite a small space for those plants.
The reason I said the lavender looks like it isn't getting enough sun is because it seems to be flopping somewhat.
