Is anyone else having difficulties with not killing their Lemon Verbena plants?

It doesn't seem to matter what I do or don't do, they shrivel up and flop in a matter of days from replanting them.
I'm giving them hardly any water, and at least one of them is in a fairly wind-prove spot.

Any tips on how to keep these lovely plants alive?

Thank you!