Sounds like it is a newly planted tree. Perhaps, if there is a problem removing it, it could be relocated on the property . Oak trees do grow quickly and provide shade which is IMO essential.
Minds are like parachutes; they work better when they are open.
