I'm not sure what the problem is. Is the house under some sort of (historical) protection? Are the trees? I don't know the laws of your country/state/county, but unless it is, no one has any right to tell you what you can or cannot do with your own property (F them I'd say).
It's okay to be considerate, but if that means you have to look/care for something that you absolutely DON'T care for/want/like, no one has a right to force that upon you.
The law in my country states that a tree for instance (planted by you or not doesn't matter AND EVEN IF IT'S ON YOUR PERSONAL PROPERTY!) can't legally (aka with a permit) be cut down if the trunk circumference is 100cm at 1m height.
Same with houses. If they are of historical/cultural significance, there's a bunch you can't do to it, even if you own it (like demolishing a wall to expand)
The community? You don't owe them anything, remember that. They can always move away themselves in hopes of freeloading somewhere else.
