At my house... The wasps like to hibernate in the walls.
One time I tore out part of an outside wall, and hundreds of wasps came spilling out...
Not sure that wasps have queens... I always figured that this years hunter/gatherer/soldier wasps became next years moms.
Bumble bees... On the other hand... I've found hibernating in holes in the ground...