We always cut the root stock down to the graft the following spring after grafting the previous year.
And yes, you don't want any of the root stock coming up again as that will diminish your growth of the new graft.
A rule of thumb, always remove any root stock growth when it can still be nipped away with just your fingers before it gets a chance to take off.