Yes, unfortunately you are supposed to remove all the fruit during the tree's first year after transplanting so that it can grow more roots and leaves. Give it a bit more citrus-specific fertilizer too, so it can get down to business and be really strong for next year's crop.
It's gotta be the hardest thing to do, always the right thing is.
