I lived in the area for a few years. You're going to have to get used to a while new way of looking at plants & gardens. See, I'm a south Floridian like you & I was completely lost when we moved to north FL. Nothing is going to bloom year round - just forget that right now. Everything is now going to be seasonal. It was really hard for me to adapt. Get anything tropical out of your mind. Just go ahead & do it now. It will save you pain later. Do not try to grow ANY tender plants - forget about it! No, well maybe they'll survive, they won't.
OK, now you think azaleas - learn how to grow them & when to prune them
Gardenias
Hostas
No, Tally is not cold enough for tulips - don't waste your money
Daylilies
Mahonia
Hollies
Redbud
Tea Olive - Osmanthus fragrans.
Tea Olive (Osmanthus fragrans)
Crepe Myrtle
Tulip Poplar
liriope
Camellias
Dogwoods
Hydrangeas
Japanese red maple
Magnolias
You could do some Witch Hazel down by the creek/lake also sassafras
Non tropical gingers
Pentas
Milkweed
Salvia
You absolutely must go to
https://www.tallahasseenurseri...
Allow a whole day. I'm serious! It's HUGE. More importantly, they know their stuff backwards & forward.
There's a hibiscus -- I forget the name - it has blooms the size of dinner plates & will withstand the cold. Would never grow in south FL. Ask Tally Nursery, they'll know what I'm talking about.
You'll doubtless have trouble with deer & moles. Just a warning.