The Next Generation Heterogeneous Satellite Communication Networks: Integration of Resource Management and Deep Reinforcement Learning

被引:69
作者
Deng, Boyu [1 ,2 ]
Jiang, Chunxiao [1 ,2 ,3 ]
Yao, Haipeng [4 ]
Guo, Song [5 ]
Zhao, Shanghong [1 ]
机构
[1] Air Force Engn Univ, Xian, Shaanxi, Peoples R China
[2] Tsinghua Univ, Beijing, Peoples R China
[3] Tsinghua Univ, Dept Elect Engn, Beijing, Peoples R China
[4] Beijing Univ Posts & Telecommun, Beijing, Peoples R China
[5] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Satellites; Feature extraction; Computer architecture; Reinforcement learning; Protocols; Resource virtualization;
D O I
10.1109/MWC.001.1900178
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
This article proposes an innovative resource management framework for the next generation heterogeneous satellite networks (HSNs), which can achieve cooperation between independent satellite systems and maximizing resource utilization. The key points of the proposed design lie in the architecture that supports the intercommunication between different satellite systems, and the SDN/NFV-based management offering the matching between resources and services. Based on the framework, we then apply deep reinforcement learning (DRL) into the system due to its strong ability in optimal matching. The two problems of multiobjective reinforcement learning and multiagent reinforcement learning are studied to adapt the development of the HSN. The combination of the DRL and resource allocation achieves integrated resource management across different satellite systems and achieves resource allocation in the HSN which can be implemented more flexibly and efficiently.
引用
收藏
页码:105 / 111
页数:7
相关论文
共 14 条
[1]  
[Anonymous], [No title captured]
[2]   Power Allocation in Multibeam Satellite Systems: A Two-Stage Multi-Objective Optimization [J].
Aravanis, Alexis I. ;
Shankar, Bhavani M. R. ;
Arapoglou, Pantelis-Daniel ;
Danoy, Gregoire ;
Cottis, Panayotis G. ;
Ottersten, Bjoern .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2015, 14 (06) :3171-3182
[3]   Joint Minimization of the Energy Costs From Computing, Data Transmission, and Migrations in Cloud Data Centers [J].
Canali, Claudia ;
Chiaraviglio, Luca ;
Lancellotti, Riccardo ;
Shojafar, Mohammad .
IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2018, 2 (02) :580-595
[4]   Service Provider Competition and Cooperation in Cloud-Based Software Defined Wireless Networks [J].
Ding, Jiefei ;
Yu, Rong ;
Zhang, Yan ;
Gjessing, Stein ;
Tsang, Danny H. K. .
IEEE COMMUNICATIONS MAGAZINE, 2015, 53 (11) :134-140
[5]   Optimal Power Allocation for SCMA Downlink Systems Based on Maximum Capacity [J].
Han, Shuai ;
Huang, Yiteng ;
Meng, Weixiao ;
Li, Cheng ;
Xu, Nuo ;
Chen, Dageng .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2019, 67 (02) :1480-1489
[6]   MACHINE LEARNING PARADIGMS FOR NEXT-GENERATION WIRELESS NETWORKS [J].
Jiang, Chunxiao ;
Zhang, Haijun ;
Ren, Yong ;
Han, Zhu ;
Chen, Kwang-Cheng ;
Hanzo, Lajos .
IEEE WIRELESS COMMUNICATIONS, 2017, 24 (02) :98-105
[7]   Cognitive Spectrum Utilization in Ka Band Multibeam Satellite Communications [J].
Maleki, Sina ;
Chatzinotas, Symeon ;
Evans, Barry ;
Liolis, Konstantinos ;
Grotz, Joel ;
Vanelli-Coralli, Alessandro ;
Chuberre, Nicolas .
IEEE COMMUNICATIONS MAGAZINE, 2015, 53 (03) :24-29
[8]   Human-level control through deep reinforcement learning [J].
Mnih, Volodymyr ;
Kavukcuoglu, Koray ;
Silver, David ;
Rusu, Andrei A. ;
Veness, Joel ;
Bellemare, Marc G. ;
Graves, Alex ;
Riedmiller, Martin ;
Fidjeland, Andreas K. ;
Ostrovski, Georg ;
Petersen, Stig ;
Beattie, Charles ;
Sadik, Amir ;
Antonoglou, Ioannis ;
King, Helen ;
Kumaran, Dharshan ;
Wierstra, Daan ;
Legg, Shane ;
Hassabis, Demis .
NATURE, 2015, 518 (7540) :529-533
[9]   Multiobjective Reinforcement Learning for Cognitive Satellite Communications Using Deep Neural Network Ensembles [J].
Rodrigues Ferreira, Paulo Victor ;
Paffenroth, Randy ;
Wyglinski, Alexander M. ;
Hackett, Timothy M. ;
Bilen, Sven G. ;
Reinhart, Richard C. ;
Mortensen, Dale J. .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2018, 36 (05) :1030-1041
[10]   TOWARD A FLEXIBLE AND RECONFIGURABLE BROADBAND SATELLITE NETWORK: RESOURCE MANAGEMENT ARCHITECTURE AND STRATEGIES [J].
Sheng, Min ;
Wang, Yu ;
Li, Jiandong ;
Liu, Runzi ;
Zhou, Di ;
He, Lijun .
IEEE WIRELESS COMMUNICATIONS, 2017, 24 (04) :127-133