What makes you think you needed to trim them at the times you mentioned ? (Not being sarcastic, just curious.)
Are they getting full sun all day ? 6 to 8 hours worth ?
They bloom on the old wood (previous years growth), so you might be preventing bloom by pruning them twice a year as mentioned.
