An analysis of model internals revealed a low-dimensional space with three interpretable dimensions matching a formal pre-specified framework for the geometry of legal concepts, showing how legal thought in LLMs may be organized and directed.
Peng Qian, Andrew Li, Sam S. Chen et al.· 0 citations
Across 12 open-source and commercial LLMs on a novel 140,000-trial product choice benchmark, context induces human-like shifts in choice and problem categorization, but does not reliably reweight attention between features like price and quality.
Johnathan Sun, A. Shleifer, Yonatan Belinkov· 0 citations
This work introduces MAxBench, a geometry-agnostic evaluation framework for multinomial concept representations based on sampling from the recovered concept representation, and finds that affine subspaces steer more reliably and have greater recall than rank-one or linear subspaces.
Divya Appapogu, Freya Behrens, Yonatan Belinkov et al.· 0 citations
The history and current state of interpretability taxonomized according to the types of causal units utilized, as well as methods used to search over mediators are described.
Aaron Mueller, Jannik Brinkmann, Millicent Li et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.