How about posting a picture of your plant for us, Evelyn? I've had a Charles Grimaldi for 3 years, and although it is in a huge pot and is over 6ft. tall now, mine is not the most vigorous brugmansia. Most of my others are far more lusty and bloom more often, too.
When you bring it in for the winter, don't forget it really likes lots of water as well as fert, and humidity. So spraying it with water from a spray bottle will help it get through the winter, too. They are tropical plants so they will grow and even bloom year 'round if you keep them warm enough and can give them enough sunlight. Use warm water to water it, too. Cold water will shock it and could set it back.