Toward Intelligent Non-Terrestrial Networks Through Symbiotic Radio: A Collaborative Deep Reinforcement Learning Scheme

被引:2
作者
Cao, Yang [1 ]
Lien, Shao-Yu [2 ]
Liang, Ying-Chang [3 ]
Niyato, Dusit [4 ]
机构
[1] Southwest Jiaotong Univ, Sch Informat Sci & Technol, Chengdu 611756, Peoples R China
[2] Natl Yang Ming Chiao Tung Univ, Inst Intelligent Syst, Tainan 711010, Taiwan
[3] Univ Elect Sci & Technol China, Ctr Intelligent Networking & Commun CINC, Chengdu 611731, Peoples R China
[4] Nanyang Technol Univ, Coll Comp & Data Sci, Singapore 639798, Singapore
来源
IEEE NETWORK | 2025年 / 39卷 / 01期
基金
新加坡国家研究基金会;
关键词
Low earth orbit satellites; Satellite broadcasting; Collaboration; Symbiosis; Optimization; Task analysis; Payloads; Non-terrestrial networks (NTNs); multi-tier collaboration; deep reinforcement learning (DRL); symbiotic radio; RESOURCE-MANAGEMENT; VEHICULAR NETWORKS; LEO;
D O I
10.1109/MNET.2024.3424874
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With the merit of global coverage, non-terrestrial networks (NTNs) with low-earth-orbit (LEO) satellite constellations have been regarded as a promising innovation to support ubiquitous connectivity. However, due to the high orbital velocity, each LEO satellite can only service a different set of ground terminals (GTs) for few minutes, and thus it is difficult to utilize machine learning (ML) based and non-ML based algorithms to tackle high-dimensional resource optimizations within such a short dwell duration. To tackle this challenge, an effective solution lies in constructing collaborations between multiple LEO satellites and GTs to jointly address the resource optimization. In this article, motivated by the mutualism advantage in symbiotic radios, we therefore propose a novel collaborative learning scheme for implementing intelligent NTNs, in which each GT with powerful computing capability operates a groundtier learning agent to assist LEO satellites tackling GT resource allocation tasks. Each LEO satellite also operates as a space-tier learning agent and the learning model of the LEO satellite can be transferred to its successor satellite as a starting point to continue updating the learning model. Finally, comprehensive simulations are conducted with a Walker-Delta satellite constellation and a channel model composed of free-space path-loss and Rician fading, and the simulation results show that the proposed scheme outperforms DRL benchmarks with more than 5.9% improvements toward the optimal average overall throughput performance over a sufficient number of elevation angle samples from the interval of [31 degrees, 90 degrees].
引用
收藏
页码:211 / 219
页数:9
相关论文
共 15 条
[1]   Latency-Aware Offloading in Integrated Satellite Terrestrial Networks [J].
Abderrahim, Wiem ;
Amin, Osama ;
Alouini, Mohamed-Slim ;
Shihada, Basem .
IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2020, 1 :490-500
[2]   Multi-tier Collaborative Deep Reinforcement Learning for Non-terrestrial Network Empowered Vehicular Connections [J].
Cao, Yang ;
Lien, Shao-Yu ;
Liang, Ying-Chang .
2021 IEEE 29TH INTERNATIONAL CONFERENCE ON NETWORK PROTOCOLS (ICNP 2021), 2021,
[3]   Stochastic Transceiver Optimization in Multi-Tags Symbiotic Radio Systems [J].
Chen, Xihan ;
Cheng, Hei Victor ;
Shen, Kaiming ;
Liu, An ;
Zhao, Min-Jian .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (09) :9144-9157
[4]   The Next Generation Heterogeneous Satellite Communication Networks: Integration of Resource Management and Deep Reinforcement Learning [J].
Deng, Boyu ;
Jiang, Chunxiao ;
Yao, Haipeng ;
Guo, Song ;
Zhao, Shanghong .
IEEE WIRELESS COMMUNICATIONS, 2020, 27 (02) :105-111
[5]   Ultra-Dense LEO Satellite Constellations: How Many LEO Satellites Do We Need? [J].
Deng, Ruoqi ;
Di, Boya ;
Zhang, Hongliang ;
Kuang, Linling ;
Song, Lingyang .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (08) :4843-4857
[6]   Reinforcement Learning for Satellite Communications: From LEO to Deep Space Operations [J].
Ferreira, Paulo Victor R. ;
Paffenroth, Randy ;
Wyglinski, Alexander M. ;
Hackett, Timothy M. ;
Bilen, Sven G. ;
Reinhart, Richard C. ;
Mortensen, Dale J. .
IEEE COMMUNICATIONS MAGAZINE, 2019, 57 (05) :70-75
[7]   Intelligent Hybrid Nonorthogonal Multiple Access Relaying for Vehicular Networks in 6G [J].
Jiao, Jian ;
He, Yizhi ;
Wu, Shaohua ;
Zhang, Qinyu .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (19) :14773-14786
[8]   Inter-Plane Inter-Satellite Connectivity in Dense LEO Constellations [J].
Leyva-Mayorga, Israel ;
Soret, Beatriz ;
Popovski, Petar .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (06) :3430-3443
[9]   Service-Oriented Dynamic Resource Slicing and Optimization for Space-Air-Ground Integrated Vehicular Networks [J].
Lyu, Feng ;
Yang, Peng ;
Wu, Huaqing ;
Zhou, Conghao ;
Ren, Ju ;
Zhang, Yaoxue ;
Shen, Xuemin .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (07) :7469-7483
[10]  
Solutions for NR To Support Non-terrestrial Networks (NTN), 2020, Standard 3GPP TR 38.821v16.0.0