I have been doing it for years. In some cases, when I have to empty the whole pot, I leave it in a pile and then use it for the bottom filling of other pots some other day... after well aeration.... In fact, nothing goes waste. The top one third is the crucial thing. When we water, the nutrients nourish the soil down ward.