As fast as vitex grow... I'm having a hard time seeing this as a big deal.
Shrubs are difficult to make standards of for long.
Personally, I think I'd tie it back to the post and enjoy it for what it is.
I suspect that removing the stake now would only hasten injury.
alternatively...
I'd think about a hard rejuvenation pruning in February.
If cut back entirely to the ground, vitex should spring right back.
After cutting tree down... those fat limbs can be covered over with soil for additional plants. Very easy to root in my experience.