Joint resource allocation and power control for D2D communication with deep reinforcement learning in MCC

被引:28
作者
Wang, Dan [1 ]
Qin, Hao [1 ]
Song, Bin [1 ]
Xu, Ke [1 ]
Du, Xiaojiang [2 ]
Guizani, Mohsen [3 ]
机构
[1] Xidian Univ, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[2] Temple Univ, Dept Comp & Informat Sci, Philadelphia, PA 19122 USA
[3] Qatar Univ, Dept Engn, Doha, Qatar
基金
中国国家自然科学基金;
关键词
D2D; DRL; Resource allocation; Power control;
D O I
10.1016/j.phycom.2020.101262
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Mission-critical communication (MCC) is one of the main goals in 5G, which can leverage multiple device-to-device (D2D) connections to enhance reliability for mission-critical communication. In MCC, D2D users can reuses the non-orthogonal wireless resources of cellular users without a base station (BS). Meanwhile, the D2D users will generate co-channel interference to cellular users and hence affect their quality-of-service (QoS). To comprehensively improve the user experience, we proposed a novel approach, which embraces resource allocation and power control along with Deep Reinforcement Learning (DRL). In this paper, multiple procedures are carefully designed to assist in developing our proposal. As a starter, a scenario with multiple D2D pairs and cellular users in a cell will be modeled; followed by the analysis of issues pertaining to resource allocation and power control as well as the formulation of our optimization goal; and finally, a DRL method based on spectrum allocation strategy will be created, which can ensure D2D users to obtain the sufficient resource for their QoS improvement. With the resource data provided, which D2D users capture by interacting with surroundings, the DRL method can help the D2D users autonomously selecting an available channel and power to maximize system capacity and spectrum efficiency while minimizing interference to cellular users. Experimental results show that our learning method performs well to improve resource allocation and power control significantly. (C) 2020 The Authors. Published by Elsevier B.V.
引用
收藏
页数:9
相关论文
共 27 条
[1]   5G D2D Networks: Techniques, Challenges, and Future Prospects [J].
Ansari, Rafay Iqbal ;
Chrysostomou, Chrysostomos ;
Hassan, Syed Ali ;
Guizani, Mohsen ;
Mumtaz, Shahid ;
Rodriguez, Jonathan ;
Rodrigues, Joel J. P. C. .
IEEE SYSTEMS JOURNAL, 2018, 12 (04) :3970-3984
[2]  
Beard C., 2017, 2017 WIR TEL S WTS, P1
[3]  
Belleschi M, 2011, IEEE GLOBE WORK, P358, DOI 10.1109/GLOCOMW.2011.6162471
[4]  
Cohen K., 2017, 170402613 ARXIV
[5]  
Dan Wang, 2018, IEEE Communications Magazine, V56, P114, DOI 10.1109/MCOM.2018.1701310
[6]   Design Aspects of Network Assisted Device-to-Device Communications [J].
Fodor, Gabor ;
Dahlman, Erik ;
Mildh, Gunnar ;
Parkvall, Stefan ;
Reider, Norbert ;
Miklos, Gyorgy ;
Turanyi, Zoltan .
IEEE COMMUNICATIONS MAGAZINE, 2012, 50 (03) :170-177
[7]  
Gu S., 2017, 2017 IEEE INT C ROBO, P3389, DOI 10.1109/ICRA.2017.7989385
[8]  
Krishnamachari B, IEEE T COGN COMMUN
[9]   INTELLIGENT 5G: WHEN CELLULAR NETWORKS MEET ARTIFICIAL INTELLIGENCE [J].
Li, Rongpeng ;
Zhao, Zhifeng ;
Zhou, Xuan ;
Ding, Guoru ;
Chen, Yan ;
Wang, Zhongyao ;
Zhang, Honggang .
IEEE WIRELESS COMMUNICATIONS, 2017, 24 (05) :175-183
[10]   Coalitional Games for Resource Allocation in the Device-to-Device Uplink Underlaying Cellular Networks [J].
Li, Yong ;
Jin, Depeng ;
Yuan, Jian ;
Han, Zhu .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2014, 13 (07) :3965-3977