Whether AI agents can act as scientists utilizing SAE tools for autonomous mechanistic discovery is evaluated to establish experimental model understanding as a measurable capability for closed-loop autonomous AI R&D.
Yuqiao Tan, Shihu He, Jun Zhao et al.· 0 citations
SWE-Touch is introduced, a framework that stress-tests this setting through validated Counter-Edits: plausible edits to task-relevant code that conflict with task completion, and point to detecting workspace changes, reconciling conflicting edits with the task, and verifying the affected behavior as key capabilities fo...
Yuqiao Tan, Jinxiang Meng, Fangyu Lei et al.· 1 citation
Diffusion large language models (dLLMs) are a promising alternative to autoregressive generation. However, reasoning-oriented post-training for dLLMs remains challenging. Supervised fine-tuning (SFT) for dLLMs requires dense but often off-policy masked states, while reinforcement learning (RL) relies on sparse rewards...
Continual Learning (CL) for Large Language Models (LLMs) faces a fundamental Stability-Plasticity Dilemma : balancing the plasticity to acquire new capabilities with the stability to preserve prior knowledge. While Parameter-Efficient Fine-Tuning methods, such as LoRA, enable efficient adaptation, we identify a critica...
Huanxuan Liao, Shizhu He, Yupu Hao et al.· Annual Meeting of the Associ...· 1 citation· ⚡1
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.