Skip to content
Preprint

Recommendation World Models for Future-State Control

Sep 2026 · 0 citations · 38 references
Computer Science

TL;DR

UA-TWM is introduced, a utility-anchored world-model interface that constructs nearby slate actions, estimates their target-relevant consequences, and selects an alternative subject to utility constraints, and enables target-aware selection around a trained sequential ranker.

Abstract

Sequential recommendation optimizes which items to rank, while each displayed slate also shapes subsequent feedback and user state. We study how a trained ranker can support decisions about these future consequences. We introduce UA-TWM, a utility-anchored world-model interface that constructs nearby slate actions, estimates their target-relevant consequences, and selects an alternative subject to utility constraints. The reference slate serves as a fallback when no alternative qualifies. A logged-replay instantiation combines utility and target-gain estimates with calibrated failure-risk prediction; a closed-loop instantiation uses one-step state-action prediction and updates its decisions after observed feedback. We evaluate transfer across twelve sequential backbones on MovieLens-25M and KuaiRand-Pure, and repeated target-directed interaction in KuaiSim. Attaching the interface improves Recall@20, NDCG@20, and future-state alignment for every matched logged backbone. Selection ablations reveal the utility and risk costs of aggressive target pursuit, while closed-loop diagnostics isolate the contribution of action-conditioned prediction. Local consequence modeling thus enables target-aware selection around a trained sequential ranker.

View source

Similar papers

#artificial intelligence Preprint Sep 2026

DeepJEPA: Scaling World Models from Within

DeepJEPA is introduced, a weight-tied joint-embedding predictive world model that treats transition depth as an inner test-time scaling axis and learns when another recurrent update is worth computing for each candidate and rollout step.

Zi-Jian Jin, Yun-Bei Zhang, Yuan-Zhe Liu et al. · 1 citation
#machine learning Preprint Oct 2026

When Low Prediction Error Misleads Planning: Diagnosing Representation, Dynamics, and Decision Failures in Latent World Models

The component that dominates a latent world model's prediction error need not be the one whose repair most improves action selection. We show this by comparing action sequences from identical physical starts and separating endpoint error into a candidate-pool center and action-relative responses. Across four model fami...

Rui Min, Xian-Yao Li, Fang Xu et al. · 1 citation
#artificial intelligence Preprint Oct 2026

Reinforcement Learning with Conformal Action Sets: An Application to Sequential Recommendation

Sequential recommenders typically use a fixed slate size even though the number of useful alternatives changes within a session. We propose Reinforcement Learning with Calibrated Pruning (RLCP), which adapts the retained action set using critic scores and an online threshold. The threshold is updated from binary feedba...

Wen-Wen Si, Hong-Hao Wei · 0 citations
Open access Aug 2026

Multimodal Interest-Shifting Sequence Recommendation with Offline Policy Optimization and Drift-Aware Representation Learning

The reported results indicate competitive public-data sequential ranking under the stated protocol, together with a reproducible and inference-safe evaluation design, and the practical value of the method lies in reaching, and in several comparisons, significantly exceeding, the accuracy of heavyweight multimodal-LLM-s...

Chang-Cheng Shao, Cheng Zeng, Xiao-Gang Ye et al. · 0 citations
Preprint Oct 2026

TwinJEPA: Action-Preferred Predictive Representations for Goal-Conditioned Control

The results suggest that local action-comparison supervision can complement temporal prediction by encouraging JEPA-based representations to retain both long-horizon temporal structure and fine-grained distinctions among locally observed actions for offline zero-shot control.

Fei-Ran You, Hong-Yang Du · 1 citation
#artificial intelligence Preprint Oct 2026

PEARL: Process-Experience Aware Reinforcement Learning for Multi-Turn Agents

Terminal rewards make multi-turn agents trainable without step-level annotations, but group-relative advantages provide little guidance about which intermediate decisions to adjust. Failed trajectories also contain reasonable actions, while unfavorable decision patterns can recur as training proceeds. We introduce PEAR...

Jie Yang, Mian-Qiu Huang, Yi-Wei Zhao et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.