MultiPathFormer, an autoregressive foundation model that represents each transmitter-receiver link as an ordered sequence of continuous-valued path tokens and pretrains with next-path prediction, is presented, showing that path-level pretraining can learn reusable representations of wireless propagation.
Abstract
Recent advances in machine learning have enabled training of wireless foundation models, which aim to support tasks such as channel estimation, beam prediction, and localization based on wireless signals. Existing wireless foundation models typically pretrain on channel tensors using masked reconstruction over subcarriers, antennas, or time but ignore the physical characteristics of wireless propagation. In this work, we propose to instead use multipath propagation as the fundamental pretraining object. We present MultiPathFormer, an autoregressive foundation model that represents each transmitter-receiver link as an ordered sequence of continuous-valued path tokens and pretrains with next-path prediction. We introduce an Environmental RAG (retrieval-augmented generation) mechanism and a first-path codebook on top of the transformer backbone, leveraging environment knowledge to improve path statistics estimation like delay and power by up to 59%. MultiPathFormer pretrained on 27 environments transfers to unseen users and, after scenario-specific fine-tuning, outperforms training the corresponding models from scratch in new environments. Across downstream tasks, it outperforms SOTA channel-based foundation models, achieving 5.57 m mean localization error, 0.914 top-3 beam accuracy, 0.994 line-of-sight classification accuracy, and 0.561 channel estimation NMSE. These results show that path-level pretraining can learn reusable representations of wireless propagation.
Channel2World is proposed, a wireless foundation model that learns a reusable environment-level representation from multiple-input multiple-output (MIMO) channel-position observations that generalizes across deployments and provides effective conditioning in unseen environments.
Hyung-Joo Moon, J. Jang, Kwang Soon Kim et al.· 0 citations
A unified framework for FM-based wireless localization that learns transferable channel representations from large-scale unlabeled channel state information and adapts to new environments with minimal or even no supervision is presented.
Guangjin Pan, Jia-Jia Guo, Zheng Xing et al.· 0 citations
This study approaches diffuse reflectors from the perspective of uncertainty, investigating the statistical properties of indoor diffuse and specular reflections and provides a feasibility proof for the separability of diffuse and specular environmental features in CIRs.
Ye Tian, Xue-Ting Xu, Xue-Min Hong et al.· IEEE Transactions on Wireles...· 0 citations
Foundation models, i.e., large neural networks pretrained on broad unlabeled data and adapted to many downstream tasks, have reshaped natural language processing and computer vision and are now being explored for the wireless physical layer. Wireless Physical-Layer Foundation Models (WPFMs) aim to learn transferable re...
Mohammad Cheraghinia, Davide Buffelli, Liulian Li et al.· 0 citations
In-Context Signal Completion (ICSC) is presented, demonstrating that small language models fine-tuned with Group Relative Policy Optimization and physics-informed rewards can reconstruct RSSI across sequential extrapolation and spatial interpolation tasks.
Reconfigurable intelligent surfaces (RISs) are a promising technology for sixth-generation (6G) wireless networks. However, the independent mobility of multiple users and inaccurate prior information can cause the propagation of channel estimation errors in RIS-assisted slowly time-varying sparse cascaded channels. By...
Yu-Xiang Deng, Hong-Gui Deng, Vaskar Sen et al.· IEEE Communications Letters· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.