It depends.... if its a native bee like bumblebees leave alone their nests don't get as big. and they are really hurting these days because of humans. same goes with leaf cutter bees, miner bees
Where do you live? Africanized or killer bees are becoming an issue in the southern us. . those you DO NOT want. they can put you in the ER.
if its yellow jackets/hornets you got a problem. there nests can be over a meter wide and contain thousands of workers all ready to sting. at the slightest disturbance. Can you post pictures of the workers, so we know.
