Throughput Maximization by Deep Reinforcement Learning With Energy Cooperation for Renewable Ultradense IoT Networks

被引:15
作者
Li, Ya [1 ]
Zhao, Xiaohui [1 ]
Liang, Hui [1 ]
机构
[1] Jilin Univ, Coll Commun Engn, Changchun 130012, Peoples R China
基金
中国国家自然科学基金;
关键词
Reinforcement learning; Internet of Things; Throughput; Resource management; Base stations; Energy harvesting; Renewable energy sources; Deep reinforcement learning (DRL); energy cooperation; energy harvesting (EH); Internet of Things (IoT); renewable ultradense networks (UDNs); throughput maximization; POWER ALLOCATION; DENSE NETWORKS; SYSTEMS; INTERNET;
D O I
10.1109/JIOT.2020.3002936
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Ultradense network (UDN) is considered as one of the key technologies for the explosive growth of mobile traffic demand on the Internet of Things (IoT). It enhances network capacity by deploying small base stations in large quantities, but it simultaneously causes great energy consumption. In this article, we use energy harvesting (EH) and energy cooperation technologies to maximize system throughput and save energy. Considering that the energy arrival process and channel information are not available a priori, we propose an optimal deep reinforcement learning (DRL) algorithm to solve this average throughput maximization problem over a finite horizon. We also propose a multiagent DRL method to solve the dimensionality problem caused by the expansion of the state and action dimensions. Finally, we compare these algorithms with two traditional algorithms, greedy algorithm and conservative algorithm. The numerical results show that the proposed algorithms are valid and effective in increasing system average throughput on the long term.
引用
收藏
页码:9091 / 9102
页数:12
相关论文
共 50 条
[41]   Influence Maximization for Signed Networks Based on Evolutionary Deep Reinforcement Learning [J].
Ma L.-J. ;
Hong H.-P. ;
Lin Q.-Z. ;
Li J.-Q. ;
Gong M.-G. .
Ruan Jian Xue Bao/Journal of Software, 2023, 34 (11) :5084-5112
[42]   VNF Scheduling and Sampling Rate Maximization in Energy Harvesting IoT Networks [J].
Zhang, Longji ;
Chin, Kwan-Wu .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (12) :14441-14458
[43]   Sum Throughput Maximization Scheme for NOMA-Enabled D2D Groups Using Deep Reinforcement Learning in 5G and Beyond Networks [J].
Khan, Mohammad Aftab Alam ;
Kaidi, Hazilah Mad ;
Ahmad, Norulhusna ;
Rehman, Masood Ur .
IEEE SENSORS JOURNAL, 2023, 23 (13) :15046-15057
[44]   Energy-Efficiency Maximization of Multiple RISs-Enabled Communication Networks by Deep Reinforcement Learning [J].
Aung, Pyae Sone ;
Tun, Yan Kyaw ;
Han, Zhu ;
Hong, Choong Seon .
IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, :2181-2186
[45]   Deep Reinforcement Learning Based Pricing Strategy of Aggregators Considering Renewable Energy [J].
Chuang, Yu-Chieh ;
Chiu, Wei-Yu .
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2022, 6 (03) :499-508
[46]   Computation Rate Maximization for SCMA-Aided Edge Computing in IoT Networks: A Multi-Agent Reinforcement Learning Approach [J].
Liu, Pengtao ;
An, Kang ;
Lei, Jing ;
Sun, Yifu ;
Liu, Wei ;
Chatzinotas, Symeon .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (08) :10414-10429
[47]   Network-Wide Energy-Efficiency Maximization in UAV-Aided IoT Networks: Quasi-Distributed Deep Reinforcement Learning Approach [J].
Lee, Seungmin ;
Ban, Tae-Won ;
Lee, Howon .
IEEE INTERNET OF THINGS JOURNAL, 2025, 12 (11) :15404-15414
[48]   Deep Reinforcement Learning Based Admission Control for Throughput Maximization in Mobile Edge Computing [J].
Zhou, Yitong ;
Ye, Qiang ;
Huang, Hui ;
Du, Hongwei .
2021 IEEE 94TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2021-FALL), 2021,
[49]   A Review of Deep Reinforcement Learning for Smart Building Energy Management [J].
Yu, Liang ;
Qin, Shuqi ;
Zhang, Meng ;
Shen, Chao ;
Jiang, Tao ;
Guan, Xiaohong .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (15) :12046-12063
[50]   Energy-Aware Deep Reinforcement Learning Scheduling for Sensors Correlated in Time and Space [J].
Hribar, Jernej ;
Marinescu, Andrei ;
Chiumento, Alessandro ;
Dasilva, Luiz A. .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (09) :6732-6744