Teng-Fei Ma

Hesitation Has a Geometry: Entropy-Trained Hyperbolic Probes for Sparse Activation Steering

When a large language model solves a mathematical problem, its reasoning is largely hierarchical, and the solution often branches at a few tokens where the next-token entropy is high. Such tree-like structure embeds in hyperbolic space with far lower distortion than in Euclidean space. Activation steering, however, usu...