I would agree with Terry could be lack of sun. Have you had a tree that grew and is now shading your border more? Lack of water could do it. Also what is your soil like? Might need some top dressing or fertilizer like Elena mentioned, or they just might not like your growing zone so they are not happy and are dwindling away?
Pictures might be helpful.
