We need more information...
Like soil type...
I've read that the way to grow lavender is to put in a sand berm...
At my house in the sand hills, I could probably grow lavender... I can certainly grow other drainage loving plants, like rosemary and sage...
If you are in the clay, probably be a big heartbreak... if you are already growing lavender, then... maybe encouraging it to spread would be doable.
Almost anything besides turf gets my endorsement...
