Hesitation Has a Geometry: Entropy-Trained Hyperbolic Probes for Sparse Activation Steering
When a large language model solves a mathematical problem, its reasoning is largely hierarchical, and the solution often branches at a few tokens where the next-token entropy is high. Such tree-like structure embeds in hyperbolic space with far lower distortion than in Euclidean space. Activation steering, however, usu...
Ze-Yong Zhang, Tung Sum Thomas Kwok, Teng-Fei Ma et al.
· 0 citations