Context-Aware Reinforcement Hyper-Heuristic Allocation for Dynamic Wireless Resource Management

Abstract

Dynamic wireless resource allocation in multi-cell networks is challenging due to non-stationary traffic, intercell interference coupling, and heterogeneous quality-of-service (QoS) constraints. Conventional schedulers and standalone metaheuristics lack adaptability across operating regimes, while deep reinforcement learning (DRL) methods often incur high training complexity and stability limitations. This paper proposes a context-aware reinforcement hyper-heuristic framework for dynamic wireless resource allocation. A contextual bandit controller hierarchically selects among multiple low-level optimization heuristics based on real-time network state features. A multi-objective reward design jointly optimizes throughput, fairness, power efficiency, and allocation stability. We establish sublinear regret guarantees under the contextual bandit model and prove convergence under standard stochastic approximation conditions. Extensive simulations over 5,000 large-scale multi-cell instances demonstrate consistent improvements over proportional fair scheduling, evolutionary methods, and DRL-based allocators in throughput, Jain's fairness index, convergence speed, and robustness to traffic perturbations. Statistical tests confirm the significance of the gains. The results indicate that reinforcementdriven hyper-heuristic orchestration provides a scalable and theoretically grounded solution for dynamic wireless resource management.