I am close to your zone and I too agree with Tarev. I usually leave all my plants out until we get down to the 30s before I bring them inside.
Cool and dry it is what encourage them to bloom in the Spring. I wondered why my cactus did not bloom. It was explained to me was because I did not let them get cool and dry long enough.