Reinforcement Learning for Resource Allocation in Energy-Harvesting Cooperative IoT Networks
TL;DR
This work exploits the concept of cooperative communication and radio frequency-based energy-harvesting to improve the network throughput while maintaining power supply to the IoTDs and employs the reinforcement learning frameworks, particularly state–action–reward–state–action (SARSA) and Q-learning.
Abstract
The internet of things (IoT) has rapidly evolved into a ubiquitous communication paradigm for enabling the deployment of autonomous wireless networks across diverse application domains. However, the limited energy storage capacity and computational resources of IoT devices (IoTDs) pose a serious concern to their long-term sustainability and the expected quality of service delivery. Moreover, in the foreseeable era of the internet of everything, centralised network resource management is likely to constrain network scalability. To tackle these challenges in the current and next-generation communication networks, the adoption of adaptive and lightweight computational frameworks coupled with energy-efficient transmission strategies is essential. To demonstrate this, we exploit the concept of cooperative communication and radio frequency-based energy-harvesting to improve the network throughput while maintaining power supply to the IoTDs. Furthermore, to intelligently and autonomously perform resource allocation, we employ the reinforcement learning frameworks, particularly state–action–reward–state–action (SARSA) and Q-learning. Based on key performance evaluation metrics, we compare our findings with the baseline methods, including the equal, random, and greedy power level selection schemes, with SARSA exhibiting the most favourable performance trade-offs.