The last two years I've been having a problem with the tree having sparse leaves and fruit. This year it but it flowered and the bees were all over it pollinating it but all the fruit has dropped. I continue to have sparse leaves on the tree.

Not sure what to do at this point. Does anybody have any ideas what can be causing these events?

Have you checked to make sure the soil is moist? How do you water?

Yeah watering isn't the problem. It gets plenty of water and sun. Its crazy because all the trees on the side of the house are doing great but the ones in the front all have issues.

Is there farming nearby, upwind possibly?

Nah, city dweller.

It is hard to tell from the photo, but is the root crown covered with soil? Buried root crowns can kill the tree. Also, the leaves look pretty yellow, which may indicated over-watering or nitrogen deficiency. Lastly, the tree may benefit from a pruning to stimulate growth.