Seems like a good set-up.
Silver Maple and Quackig Aspen are both fast growers.
Sugar Maple from my experience have been slow growers, and Paper Birch are not speed queens either.
Especially on the Sugar Maple make sure the roots do not circle and kill the trees when you plants.