Stramonium lilac le Fleur blooms very quickly. They also stay smaller than many Datura - very diminutive. And no need to move to a huge pot cause like I say - they stay fairly small. At least here.
3 in 5 gallon will certainly be ok.
And if you want - disbud some and let a couple flower but then remove so it does not make seed. Play around. And let some go to seed.
This Datura does not get huge. Some of the others I sent will get 3 or 4 feet or so.
@Kareoke - I planted ~ 20 seeds of 2 different types of Brugs and have Zero germination.