Sparse activation with measurable boundaries.

Sparse activation is being explored as an efficiency direction. Any benefit must be measured on the relevant model, hardware, task, and quality controls rather than assumed from the architecture alone.