We have 3 of 19 papers
We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.
Not the right person? Other researchers publish under this name.
This work takes a fine-grained look at memorization by decomposing the loss trajectory of memorized sequences over training and model parameters, finding that memorization in both cases is characterized by sequence-level gradient alignment.
We propose the AIMO Interpretability Challenge, a competition on distinguishing robust from spurious reasoning in frontier mathematical language models based on the models'internal mechanisms. The challenge is motivated by a central limitation of standard reasoning benchmarks: strong final-answer accuracy does not reve...
The Last Translation Benchmark is introduced, a collection of human-authored and peer-reviewed examples that break leading machine translation models and a new evaluation approach: each example comes with handcrafted verification rules describing concrete failure cases on that example, therefore allowing reliable and a...
We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.
