Surprisingly, frozen recurrent networks support recall over hundreds of steps and achieve competitive control performance across diverse POMDPs, while using less than half the number of trainable parameters required by their fully trainable counterparts.
Continual post-training faces a dual challenge of acquisition and retention: models must learn new capabilities while preserving prior knowledge. While Self-Distillation Fine-Tuning (SDFT) mitigates this using self-supervision with in-context demonstrations, it relies on strong in-context learning and instruction-follo...
Woosung Koh, Hyunsoo Lee, Kyungjae Lee et al.· 0 citations
The optimization objective for e-commerce advertising creatives has shifted from aesthetic quality to online business metrics like click-through rate (CTR). Recent methods generate appealing ad images from product images by constructing CTR-based reward signals and refining prompt generation via Reinforcement Learning....
Xu Zhang, Haohan Wang, Zheng Zhang et al.· 0 citations
Counterfactual text editing is the ability to revise a given text in light of a hypothetical change while preserving facts not causally affected by that change. When asked what would have happened if a doctor had not recommended surgery, the model output should retain the patient's medical history and modify only the c...
Arvind Raghavan, Inwoo Hwang, Shreyas Havaldar et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Multi-view representations enable pretrained image and video vision-language models to understand 3D scenes, but their long visual token sequences make inference costly. Redundancy arises both from repeated observations of the same scene regions across views and from processing all visual tokens at every LLM layer, reg...
Yong-Xing Zheng, Hao Wu, Fang Li et al.· 0 citations
As LLMs become increasingly capable of implementing software, a critical bottleneck emerges: whether they truly understand what users want. Users often begin with vague intent, leaving important requirements to be clarified through interaction. In repository-level development, misunderstandings can propagate and cause...
Ming-Yu Chen, Zhiqing Zhong, Man-Yi Wang et al.· 0 citations
Reinforcement learning has become the foundational paradigm for enhancing the reasoning capabilities of LLMs. Yet the dominant approach, Proximal Policy Optimization (PPO), relies on a geometrically degenerate clipping proxy that cannot adapt its resistance to policy shifts, leading to premature clipping and degraded e...
Zhi-Cheng Cai, Xin-Yuan Guo, Han Wu et al.· 0 citations
Supervised fine-tuning (SFT) remains a widely used approach for post-training large language models, because fixed demonstrations can directly introduce desired reasoning strategies and behavioral patterns. Yet forcing a model to imitate externally provided trajectories may also interfere with behaviors already support...
Yuxuan Gu, Ke-Quan Niu, Xiao-Cheng Feng et al.· 0 citations
Visual interventions provide a training-free way to reduce hallucinations in multimodal large language models. However, an intervention may have little leverage at some layers and may damage a correct answer even when it changes the output. We investigate where visual interventions retain leverage and when they improve...
Qi-Ji Zhou, Jun-Yi Hu, Pei-Yu Wang et al.· 0 citations
Video editing models achieve strong performance in modifying appearance, backgrounds, styles, and motions, empowered by large-scale training data. Beyond general scenarios, professional motions are significant in performance, sports, and martial arts. This paper focuses on professional motion editing, which involves fi...
Si-Yi Qian, Han-Qing Yang, Wei-Huang Lin et al.· 0 citations
Embodied agents must translate multimodal observations and user requests into executable actions while adapting to product constraints, changing goals, and execution feedback. We present JoyInside-VLM-Agent, a ReAct-style multimodal agent developed through product-conditioned trajectory construction and staged policy l...
Gangyi Li, LuYao Wang, Jingfu Sun et al.· 0 citations
Decoder hidden states from different layers of large language models (LLMs) often encode complementary information. However, existing speculative decoding methods typically rely on a small set of target-model layers chosen using fixed, position-based heuristics. Selecting an optimal subset of layers is inherently a com...
Raghavv Goel, Sudhanshu Agrawal, Mukul Gagrani et al.· 0 citations