You should have a super-fertile garden in the spring, Reid. Perlite will certainly help with drainage, but I don't think the vermiculite will. Vermiculite in my hands only seems to increase water retention. Vermiculite is great for seed starting though. I use perlite extensively in all my potting media and garden soil.
