Long-context language models often neglect information in the middle of the input, a phenomenon known as"lost-in-the-middle". Part of this gap may stem from the long-range decay of rotary position embedding (RoPE), which weakens the positional signal between distant tokens. Existing input compression deletes low-import...
Pei-Yu Zhang, Heng Ping, Shinibali Bhattacharyya et al.· 0 citations
Agent evolvers automate the design of the prompts, skills and workflows around language model agents, yet the optimization process they follow is still designed by hand: a fixed search loop decides how candidates are evaluated, which are kept and when the search stops. We propose FREEEVOLVE, which automates this proces...
Lecheng Kong, Li-Ke Hui, Nikos Kanakaris et al.· 0 citations
Control experiments show that SCOUT improves the teacher's ability to continue from student-generated prefixes, supporting the intended mechanism of student-conditioned teacher adaptation, and consistently improves the effectiveness of on-policy distillation.
Modern agentic systems combine an AI model with a harness that controls execution and environmental interactions. Harness design strongly affects long-horizon performance, yet its combinatorial search space demands substantial human effort that must be repeated as models change. Existing automated methods explore this...
Prithwish Jana, Mononito Goswami, Hao Liu et al.· 1 citation
This work proposes HyperLabel, an encoder-decoder framework that explicitly models label dependencies through hypergraph neural networks, and proposes a unified cross-modal learning approach where HGNN+ performs bidirectional message passing to integrate feature information with label structure, and a shared cross-atte...