On-policy distillation (OPD) improves language-model by supervising a student on prefixes sampled from its own policy, but its supervision remains confined to the output space. Consequently, OPD transfers what a teacher predicts without supervising the intermediate computation that produces those predictions. Simply di...
Ying-Dong Shi, Zhi-Hong Li, Chang-Ming Li et al.· 0 citations
Textual skills enable large language model (LLM) based agents to accumulate reusable procedural knowledge without updating model parameters. Yet existing skill evolution remains largely confined to the text space: an optimizer must diagnose success and failure patterns, and revise skills solely from long execution traj...
Kai-Xin Zhang, Chang-Ming Li, Ying-Dong Shi et al.· 0 citations
This work proposes DesignAsCode, a novel framework that reimagines graphic design as a programmatic synthesis task using HTML/CSS, incorporating a Plan-Implement-Reflect pipeline, incorporating a Semantic Planner to construct dynamic, variable-depth element hierarchies and a Visual-Aware Reflection mechanism that optim...