Omri Fahn

From Directions to Regions: Decomposing Activations in Language Models via Local Geometry

This work leverage Mixture of Factor Analyzers (MFA) as a scalable, unsupervised alternative that models the activation space as a collection of Gaussian regions with their local covariance structure, and positions local geometry, expressed through subspaces, as a promising unit of analysis for scalable concept discove...