Yep, I sit on a100' deep layer of clay. It is either like quick-sand or concrete. Nothing in between.
When I had that backyard landscaping done, the crew spent an entire day removing vegetation (scrub trees/weeds) and clay. 90% of the time was spent in the clay removal. They used a large, commercial backhoe to take it out and then hauled it away in two huge dump trucks. The landscape architect said they probably removed 20-30 tons of clay! I think he might have been talking about just one dump truck full.
That excavation was then filled in with good, highly organic soil. One advantage I/they had was that the landscape area was on a gentle hill, so having that slope helps.