Angle-norm decomposition reveals how activation steering works geometrically

Summary

The authors decompose activation steering into angular and radial components through controlled experiments across seven language models. They show that concepts are represented primarily in angular structure, but norm remains important for steering stability and downstream effects. They recommend parameterizing steering by its interpretable angular and radial components.