Experiments on the Time-MMD benchmark show that SCENARIODIFF is especially effective in event-driven domains, demonstrating the value of explicit hierarchical scenario guidance for multimodal time series forecasting.
Abstract
Textual context such as news, reports, and logs can provide valuable signals for time series forecasting, especially when future dynamics are driven by external events that are not yet visible in historical values. Existing multimodal forecasting methods often either ask large language models (LLMs) to predict numerical values directly or fuse text and time series implicitly, making contextual influence difficult to interpret and control. We propose SCENARIODIFF, a hierarchical contextual reasoning framework for multimodal time series forecasting under noisy and weakly aligned documents. SCENARIODIFF organizes contextual information into three levels: a Historical Context Agent extracts stepwise evidence from raw documents, a Scenario Agent produces a qualitative scenario description for the forecast horizon, and an Anchor Guidance Agent generates sparse anchor points for event-relevant future regions. These structured signals condition a Multimodal Diffusion Transformer, while Anchor Blended Sampling locally refines generated trajectories without retraining. Experiments on the Time-MMD benchmark show that SCENARIODIFF is especially effective in event-driven domains, demonstrating the value of explicit hierarchical scenario guidance for multimodal time series forecasting. Our full implementation is available at https://anonymous.4open.science/r/ScenarioDiff_ICDM-2C4C
Multimodal time series forecasting incorporates external textual information, such as weather reports, environmental bulletins, and warning-related descriptions, to provide additional context for numerical sequence modeling. However, existing multimodal fusion methods mainly rely on global cross-modal interactions or f...
Yadi Bi, Xue-Jie Zhang, Jia-Jun Guo et al.· 2026 8th International Confe...· 0 citations
This work defines cross-modal attention as a selection process, where semantic prompts are employed to induce a sparse temporal attribution distribution over temporal positions and employs low-entropy regularization alongside global cross-modal consistency constraints to regulate the selection behavior.
Xue-Yun Luo, Qiang Lu, Sangui Jian et al.· Proceedings of the Thirty-Fi...· 0 citations
It is concluded that, on this benchmark and within this family of frozen-encoder architectures, text content is not the operative signal behind the reported gains and the perturbation protocol and evaluation harness are released as a reusable diagnostic toolkit.
K. Sridhar, Atharva Gupta, Nishant Pradhan et al.· 1 citation
Experiments on Context-is-Key and Time-MMD across two TSFM backbones (Chronos and TimesFM) and four LLMs show that \rc{} delivers consistent improvements across model choices, supporting sequential search as an effective training-free approach to text-conditioned forecasting.
H. Nguyen, Dung Nguyen, M. Nguyen et al.· arXiv.org· 0 citations
This work introduces ReasonCast, a structured semantic intervention framework that translates event knowledge into forecast-specific operations through structured fields describing event relevance, demand direction, temporal shape, amplitude, and peak intensity.
Zi-Yue Yang, Chao Xu, Yijing Wang et al.· 0 citations
CastFSR is proposed, an agentic framework that formulates context-aware forecasting as a Fast--Slow--Reflect workflow that supports both training-free inference with off-the-shelf LLMs and efficient deployment through a two-stage SFT and reinforcement learning strategy that transfers its orchestration capability to com...
Xiao-Yu Tao, Mingyue Cheng, Bo-Kai Pan et al.· 0 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduOct 14, 2026
Learn how Google DeepMind and GovTech Singapore uses lightweight on-device Gemma models to intercept conversational scams in private chats with zero cloud data egress.
MIT News · Artificial Intelligence· news.mit.eduOct 13, 2026
Machine-learning networks can learn without detailed instructions from a designer. Those that do may offer insight into how the brain reorganizes itself during learning.
Microsoft Research Blog· microsoft.comOct 12, 2026
StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.