I use scissors for that kind of cleaning. Use the scissors like tweezers, with just enough pressure to grab but not cut. If you have any old, dull scissors, this could be their moment of new glory.
If it wasn't a plastic pot, you could turn it upside-down but roots in plastic usually slide right out.
Another option could be to use a chopstick or shish-ka-bob stick with something sticky on the end, like gum or tape.