Even millipedes, if they become over populated "tons of them in pots" can become serious pests and start eating the roots and destroying very young plant leaves. A few would not be a problem, but it sounds like they might be more than the normal amount. Something to check on anyhow!
