Simulation results show that pre-trained XNPs achieve fast adaptation to new configurations with significantly fewer training samples and epochs than a graph neural network-based baseline, demonstrating that cross-system adaptability can be achieved by exploiting shared computational structure, rather than relying on large models.
Abstract
Adapting learning-based precoding across different system configurations is challenging due to multiple types of variables and constraints. While large-scale neural networks have been proposed for cross-task adaptation, whether such adaptability requires large models remains unclear. In this paper, we identify a structural property of a class of precoding problems: the subproblems associated with each type of variable in alternative optimization (AO) share a common computational structure across systems when other variables are fixed. This structural consistency enables the reuse of update rules across systems. Based on this observation, we propose a cross-system neural precoder (XNP), where each layer implements AO-inspired update equations, which define the layer-wise input-output mappings. By reusing common update structures and learning only lightweight nonlinear mappings, the XNP enables efficient adaptation across systems only with several thousand trainable parameters. Simulation results show that pre-trained XNPs achieve fast adaptation to new configurations with significantly fewer training samples and epochs than a graph neural network-based baseline. This demonstrates that cross-system adaptability can be achieved by exploiting shared computational structure, rather than relying on large models.
Learning-based hybrid precoding has emerged as a promising solution for low-latency multi-user transmission in large-scale antenna systems. However, its practical deployment is often hindered by high training overhead, and poor generalization across varying system sizes. These limitations fundamentally stem from the fa...
Nai-Tian Zhang, Chen-Yang Yang· IEEE Open Journal of the Com...· 0 citations
Exploiting mathematical properties of wireless policies in deep neural network (DNN) design can improve learning performance and generalizability while reducing training complexity. Permutation equivariance and permutation invariance have been incorporated into DNN architectures. In this paper, we investigate conjugati...
This work reformulates LoRA-based CL as a consistent feature mapping problem that mimics the behavior of the joint-training upper bound, wherein a unified adaptation parameter matrix is learned to simultaneously capture the input-output relationships established by all task-specific LoRAs.
Yue Lu, Shizhou Zhang, De Cheng et al.· IEEE Transactions on Pattern...· 0 citations
Backpropagation (BP) has driven the remarkable success of modern deep learning by enabling large hierarchical networks to learn complex functions end-to-end. Yet it does not by itself determine how parameters should be organized so that functional components can be reused and adapted selectively. For example, object re...
CircuitSteer is introduced, a novel framework that leverages Sparse Autoencoders (SAEs) to identify and manipulate coherent semantic circuits distributed across multiple layers that yields strictly more robust and effective behavioral control than static single-point interventions.
Mehrshad Saadatinia, Parsa Razmara, Ardalan Aryashad et al.· 1 citation
Memory constraints remain a critical bottleneck in the deployment of large-scale AI models. Parameter sharing across network depth reduces model storage, but repeatedly applying an identical transformation limits flexibility across layers. Inspired by time--memory trade-offs in classical algorithms, we introduce the Li...