Modern LLM post-training composes supervised fine-tuning (SFT), reinforcement learning with verifiable rewards (RLVR), and on-policy distillation (OPD) into multi-stage pipelines, yet these stages are typically designed and evaluated in isolation. We show that this composition is consequential: a stage that improves th...
Emre Can Acikgoz, Yang Li, Z. Liu et al.· 0 citations
Just-in-Time Memory (JitMem) consistently outperforms no-memory agents as well as heuristic and learned write-time memory methods, improving over the strongest baseline by 16.2, 16.3, and 3.9 absolute success-rate points, respectively.
The results suggest that dense credit assignment through distillation can be effective when its likelihood-based scores are empirically validated as meaningful proxies for outcome-relevant credit, when this alignment does not hold.
Xuan-Phi Nguyen, Z. Liu, Yang Li et al.· 3 citations
It is found that simply training models on CoT data of atomic tasks leads to limited generalization, but minimally modifying CoT formats of constituent atomic tasks to be composable can lead to improvements.
Fangcong Yin, Zeyu Liu, Liu Leqi et al.· arXiv.org· 1 citation
TaxEL introduces Taxonomy-Guided Contrastive Sampling (TGCS), which systematically integrates both local ontology structure and global semantic similarity to generate informative positive and hard negative samples for each mention; and Structured Semantic Alignment Loss (SSAL), which enforces alignment between model pr...
Rui Hua, Zeyu Liu, Zixin Shu et al.· IEEE journal of biomedical a...· 0 citations
Procedural Memory Distillation is proposed, which converts crossepisode signals into reusable procedural memory and distills it into the policy's weights during training, yielding a memory-free model at inference.
Ye Liu, Srijan Bansal, Bo Pang et al.· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.