Mine have always done the same thing, and I haven't figured out why. They drop a lot of leaves and look ratty, but it doesn't seem to hurt their blooming when they are old enough. They still bloom like crazy. Insects are always chewing on mine, so the leaves really look bad.
