Dynamic multiple access based on deep reinforcement learning for Internet of Things

被引:1
作者
Liu, Xin [1 ]
Li, Zengqi [1 ]
机构
[1] Dalian Univ Technol, Sch Informat & Commun Engn, Dalian 116024, Peoples R China
关键词
Dynamic spectrum access; Deep reinforcement learning; Multiple access; Internet of Things; SPECTRUM ACCESS; NETWORKS; UPLINK; SECURE;
D O I
10.1016/j.comcom.2023.08.012
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the development of wireless communication technology, the rational use of spectrum resources utilizing efficient multiple access technology has become a research hotspot. The channel access strategy in dynamic spectrum access technology will directly affect the system's spectrum utilization. Deep reinforcement learning is proposed to train users in the network to learn optimal channel access strategy to achieve reasonable allocation of spectrum resources on the channel. At the same time, the multiple access scheme adopted by users who have access to the channel will also affect the throughput of the system. Traditional multiple access schemes include Orthogonal Multiple Access scheme and Non-orthogonal Multiple Access (NOMA) scheme. In a dynamic environment, the multiple access scheme suitable for users on the channel is also dynamic. Therefore, DRL is introduced to help users learn the multiple access scheme selection strategy to maximize user throughput. Finally, we propose a dynamic multiple access algorithm based on deep reinforcement learning, which optimizes the channel access strategy and scheme selection strategy respectively, and improves the performance. The simulation results show that the proposed scheme is superior to other schemes in various scenarios, especially, the average throughput of the proposed scheme is about 0.8 Mbps and 0.5 Mbps higher than that of the FDMA scheme and NOMA scheme, respectively.
引用
收藏
页码:331 / 341
页数:11
相关论文
共 36 条
[1]   A Novel Analytical Framework for Massive Grant-Free NOMA [J].
Abbas, Rana ;
Shirvanimoghaddam, Mahyar ;
Li, Yonghui ;
Vucetic, Branka .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2019, 67 (03) :2436-2449
[2]   Deep Reinforcement Learning A brief survey [J].
Arulkumaran, Kai ;
Deisenroth, Marc Peter ;
Brundage, Miles ;
Bharath, Anil Anthony .
IEEE SIGNAL PROCESSING MAGAZINE, 2017, 34 (06) :26-38
[3]   Distributed Learning-Based Cross-Layer Technique for Energy-Efficient Multicarrier Dynamic Spectrum Access With Adaptive Power Allocation [J].
Ben Ghorbel, Mahdi ;
Hamdaoui, Bechir ;
Guizani, Mohsen ;
Khalfi, Bassem .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2016, 15 (03) :1665-1674
[4]   A comprehensive survey of multiagent reinforcement learning [J].
Busoniu, Lucian ;
Babuska, Robert ;
De Schutter, Bart .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 2008, 38 (02) :156-172
[5]   Distributive Dynamic Spectrum Access Through Deep Reinforcement Learning: A Reservoir Computing-Based Approach [J].
Chang, Hao-Hsuan ;
Song, Hao ;
Yi, Yang ;
Zhang, Jianzhong ;
He, Haibo ;
Liu, Lingjia .
IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (02) :1938-1948
[6]   Relay-Assisted Federated Edge Learning: Performance Analysis and System Optimization [J].
Chen, Lunyuan ;
Fan, Lisheng ;
Lei, Xianfu ;
Duong, Trung Q. ;
Nallanathan, Arumugam ;
Karagiannidis, George K. .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2023, 71 (06) :3387-3401
[7]   Unveiling the Importance of SIC in NOMA Systems-Part 1: State of the Art and Recent Findings [J].
Ding, Zhiguo ;
Schober, Robert ;
Poor, H. Vincent .
IEEE COMMUNICATIONS LETTERS, 2020, 24 (11) :2373-2377
[8]   Distributed Machine Learning for Multiuser Mobile Edge Computing Systems [J].
Guo, Yinghao ;
Zhao, Rui ;
Lai, Shiwei ;
Fan, Lisheng ;
Lei, Xianfu ;
Karagiannidis, George K. .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2022, 16 (03) :460-473
[9]   Fusion of Building Information Modeling and Blockchain for Metaverse: A Survey [J].
Huang, Huakun ;
Zeng, Xiangbin ;
Zhao, Lingjun ;
Qiu, Chen ;
Wu, Huijun ;
Fan, Lisheng .
IEEE OPEN JOURNAL OF THE COMPUTER SOCIETY, 2022, 3 :195-207
[10]   Deep Reinforcement Learning for Online Computation Offloading in Wireless Powered Mobile-Edge Computing Networks [J].
Huang, Liang ;
Bi, Suzhi ;
Zhang, Ying-Jun Angela .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2020, 19 (11) :2581-2593