共 15 条
Deep Reinforcement Learning Assisted UAV Trajectory and Resource Optimization for NOMA Networks
被引:2
作者:

Chen, Peixin
论文数: 0 引用数: 0
h-index: 0
机构:
Nanjing Univ, Sch Elect Sci & Engn, Nanjing 210023, Peoples R China Nanjing Univ, Sch Elect Sci & Engn, Nanjing 210023, Peoples R China

Zhao, Jian
论文数: 0 引用数: 0
h-index: 0
机构:
Nanjing Univ, Sch Elect Sci & Engn, Nanjing 210023, Peoples R China Nanjing Univ, Sch Elect Sci & Engn, Nanjing 210023, Peoples R China

Shen, Furao
论文数: 0 引用数: 0
h-index: 0
机构:
Nanjing Univ, State Key Lab Novel Software Technol, Nanjing 210023, Peoples R China
Nanjing Univ, Sch Artificial Intelligence, Nanjing 210023, Peoples R China Nanjing Univ, Sch Elect Sci & Engn, Nanjing 210023, Peoples R China
机构:
[1] Nanjing Univ, Sch Elect Sci & Engn, Nanjing 210023, Peoples R China
[2] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing 210023, Peoples R China
[3] Nanjing Univ, Sch Artificial Intelligence, Nanjing 210023, Peoples R China
来源:
2022 14TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING, WCSP
|
2022年
基金:
美国国家科学基金会;
国家重点研发计划;
关键词:
UAV communication;
deep reinforcement learning;
NOMA;
dynamic environment;
COMMUNICATION;
D O I:
10.1109/WCSP55476.2022.10039197
中图分类号:
TM [电工技术];
TN [电子技术、通信技术];
学科分类号:
0808 ;
0809 ;
摘要:
Unmanned aerial vehicles (UAVs) are widely used as aerial base stations (BSs) to provide wireless communication services. In this paper, we consider the UAV's trajectory and power allocation design for downlink communication rate maximization in a UAV-enabled network in disaster areas or the cell fringe. Non-orthogonal multiple access (NOMA) is used to improve the spectrum efficiency of the entire network, while all users are roaming around randomly. The formulated problem is non-convex and the considered environment is dynamic. Such a problem is difficult to be solved via conventional optimization methods. Therefore, we propose a soft actor-critic (SAC) learning scheme to tackle the pertinent problem. Simulation results show that our proposed learning framework is more stable and has a faster convergence rate compared to baseline approaches.
引用
收藏
页码:933 / 938
页数:6
相关论文
共 15 条
[1]
Optimal LAP Altitude for Maximum Coverage
[J].
Al-Hourani, Akram
;
Kandeepan, Sithamparanathan
;
Lardner, Simon
.
IEEE WIRELESS COMMUNICATIONS LETTERS,
2014, 3 (06)
:569-572

Al-Hourani, Akram
论文数: 0 引用数: 0
h-index: 0
机构:
RMIT Univ, Sch Elect & Comp Engn, Coll Sci Engn & Hlth, Melbourne, Vic 3001, Australia RMIT Univ, Sch Elect & Comp Engn, Coll Sci Engn & Hlth, Melbourne, Vic 3001, Australia

论文数: 引用数:
h-index:
机构:

Lardner, Simon
论文数: 0 引用数: 0
h-index: 0
机构:
Challenge Networks, Melbourne, Vic 3067, Australia RMIT Univ, Sch Elect & Comp Engn, Coll Sci Engn & Hlth, Melbourne, Vic 3001, Australia
[2]
On the Application of Quasi-Degradation to MISO-NOMA Downlink
[J].
Chen, Zhiyong
;
Ding, Zhiguo
;
Dai, Xuchu
;
Karagiannidis, George K.
.
IEEE TRANSACTIONS ON SIGNAL PROCESSING,
2016, 64 (23)
:6174-6189

Chen, Zhiyong
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Sci & Technol China, Key Lab Wireless Opt Commun, Chinese Acad Sci, Sch Informat Sci & Technol, Hefei 230026, Peoples R China Univ Sci & Technol China, Key Lab Wireless Opt Commun, Chinese Acad Sci, Sch Informat Sci & Technol, Hefei 230026, Peoples R China

Ding, Zhiguo
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Lancaster, Sch Comp & Commun, Lancaster LA1 4YW, England Univ Sci & Technol China, Key Lab Wireless Opt Commun, Chinese Acad Sci, Sch Informat Sci & Technol, Hefei 230026, Peoples R China

Dai, Xuchu
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Sci & Technol China, Key Lab Wireless Opt Commun, Chinese Acad Sci, Sch Informat Sci & Technol, Hefei 230026, Peoples R China Univ Sci & Technol China, Key Lab Wireless Opt Commun, Chinese Acad Sci, Sch Informat Sci & Technol, Hefei 230026, Peoples R China

Karagiannidis, George K.
论文数: 0 引用数: 0
h-index: 0
机构:
Southwest Jiaotong Univ, Prov Key Lab Informat Coding & Transmiss, Chengdu 611756, Sichuan, Peoples R China
Aristotle Univ Thessaloniki, Elect & Comp Engn Dept, GR-54124 Thessaloniki, Greece Univ Sci & Technol China, Key Lab Wireless Opt Commun, Chinese Acad Sci, Sch Informat Sci & Technol, Hefei 230026, Peoples R China
[3]
A General MIMO Framework for NOMA Downlink and Uplink Transmission Based on Signal Alignment
[J].
Ding, Zhiguo
;
Schober, Robert
;
Poor, H. Vincent
.
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS,
2016, 15 (06)
:4438-4454

Ding, Zhiguo
论文数: 0 引用数: 0
h-index: 0
机构:
Princeton Univ, Dept Elect Engn, Princeton, NJ 08544 USA
Univ Lancaster, Sch Comp & Commun, Lancaster LA1 4WA, England Princeton Univ, Dept Elect Engn, Princeton, NJ 08544 USA

Schober, Robert
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Erlangen Nurnberg, Inst Digital Commun, D-91054 Erlangen, Germany Princeton Univ, Dept Elect Engn, Princeton, NJ 08544 USA

Poor, H. Vincent
论文数: 0 引用数: 0
h-index: 0
机构:
Princeton Univ, Dept Elect Engn, Princeton, NJ 08544 USA Princeton Univ, Dept Elect Engn, Princeton, NJ 08544 USA
[4]
The Application of MIMO to Non-Orthogonal Multiple Access
[J].
Ding, Zhiguo
;
Adachi, Fumiyuki
;
Poor, H. Vincent
.
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS,
2016, 15 (01)
:537-552

Ding, Zhiguo
论文数: 0 引用数: 0
h-index: 0
机构:
Princeton Univ, Dept Elect Engn, Princeton, NJ 08544 USA
Univ Lancaster, Sch Comp & Commun, Lancaster LA1 4WA, England Princeton Univ, Dept Elect Engn, Princeton, NJ 08544 USA

Adachi, Fumiyuki
论文数: 0 引用数: 0
h-index: 0
机构:
Tohoku Univ, Grad Sch Engn, Sendai, Miyagi 9808579, Japan Princeton Univ, Dept Elect Engn, Princeton, NJ 08544 USA

Poor, H. Vincent
论文数: 0 引用数: 0
h-index: 0
机构:
Princeton Univ, Dept Elect Engn, Princeton, NJ 08544 USA Princeton Univ, Dept Elect Engn, Princeton, NJ 08544 USA
[5]
Energy-Efficient UAV Control for Effective and Fair Communication Coverage: A Deep Reinforcement Learning Approach
[J].
Liu, Chi Harold
;
Chen, Zheyu
;
Tang, Jian
;
Xu, Jie
;
Piao, Chengzhe
.
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS,
2018, 36 (09)
:2059-2070

Liu, Chi Harold
论文数: 0 引用数: 0
h-index: 0
机构:
Beijing Inst Technol, Sch Comp Sci & Technol, Beijing 100081, Peoples R China
Sejong Univ, Dept Comp Informat & Secur, Seoul 13557, South Korea Beijing Inst Technol, Sch Comp Sci & Technol, Beijing 100081, Peoples R China

Chen, Zheyu
论文数: 0 引用数: 0
h-index: 0
机构:
Beijing Inst Technol, Sch Comp Sci & Technol, Beijing 100081, Peoples R China Beijing Inst Technol, Sch Comp Sci & Technol, Beijing 100081, Peoples R China

Tang, Jian
论文数: 0 引用数: 0
h-index: 0
机构:
Syracuse Univ, Dept Comp Sci & Engn, Syracuse, NY 13244 USA Beijing Inst Technol, Sch Comp Sci & Technol, Beijing 100081, Peoples R China

Xu, Jie
论文数: 0 引用数: 0
h-index: 0
机构:
Beijing Inst Technol, Sch Comp Sci & Technol, Beijing 100081, Peoples R China Beijing Inst Technol, Sch Comp Sci & Technol, Beijing 100081, Peoples R China

Piao, Chengzhe
论文数: 0 引用数: 0
h-index: 0
机构:
Beijing Inst Technol, Sch Comp Sci & Technol, Beijing 100081, Peoples R China Beijing Inst Technol, Sch Comp Sci & Technol, Beijing 100081, Peoples R China
[6]
Cooperative NOMA Broadcasting/Multicasting for Low-Latency and High-Reliability 5G Cellular V2X Communications
[J].
Liu, Gang
;
Wang, Zhiqing
;
Hu, Jiewen
;
Ding, Zhiguo
;
Fan, Pingzhi
.
IEEE INTERNET OF THINGS JOURNAL,
2019, 6 (05)
:7828-7838

Liu, Gang
论文数: 0 引用数: 0
h-index: 0
机构:
Southwest Jiaotong Univ, Sch Informat Sci & Technol, Chengdu 610031, Sichuan, Peoples R China
Southeast Univ, Natl Mobile Commun Res Lab, Nanjing 210096, Jiangsu, Peoples R China Southwest Jiaotong Univ, Sch Informat Sci & Technol, Chengdu 610031, Sichuan, Peoples R China

Wang, Zhiqing
论文数: 0 引用数: 0
h-index: 0
机构:
Southwest Jiaotong Univ, Key Lab Informat Coding & Transmiss, Chengdu 610031, Sichuan, Peoples R China Southwest Jiaotong Univ, Sch Informat Sci & Technol, Chengdu 610031, Sichuan, Peoples R China

Hu, Jiewen
论文数: 0 引用数: 0
h-index: 0
机构:
Southwest Jiaotong Univ, Key Lab Informat Coding & Transmiss, Chengdu 610031, Sichuan, Peoples R China Southwest Jiaotong Univ, Sch Informat Sci & Technol, Chengdu 610031, Sichuan, Peoples R China

Ding, Zhiguo
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Manchester, Sch Elect & Elect Engn, Manchester M13 9PL, Lancs, England Southwest Jiaotong Univ, Sch Informat Sci & Technol, Chengdu 610031, Sichuan, Peoples R China

Fan, Pingzhi
论文数: 0 引用数: 0
h-index: 0
机构:
Southwest Jiaotong Univ, Key Lab Informat Coding & Transmiss, Chengdu 610031, Sichuan, Peoples R China Southwest Jiaotong Univ, Sch Informat Sci & Technol, Chengdu 610031, Sichuan, Peoples R China
[7]
UAV COMMUNICATIONS BASED ON NON-ORTHOGONAL MULTIPLE ACCESS
[J].
Liu, Yuanwei
;
Qin, Zhijin
;
Cai, Yunlong
;
Gao, Yue
;
Li, Geoffrey Ye
;
Nallanathan, Arumugam
.
IEEE WIRELESS COMMUNICATIONS,
2019, 26 (01)
:52-57

Liu, Yuanwei
论文数: 0 引用数: 0
h-index: 0
机构:
Queen Mary Univ London, London, England Queen Mary Univ London, London, England

Qin, Zhijin
论文数: 0 引用数: 0
h-index: 0
机构:
Queen Mary Univ London, London, England Queen Mary Univ London, London, England

Cai, Yunlong
论文数: 0 引用数: 0
h-index: 0
机构:
Zhejiang Univ, Dept ISEE, Hangzhou, Zhejiang, Peoples R China Queen Mary Univ London, London, England

Gao, Yue
论文数: 0 引用数: 0
h-index: 0
机构:
Queen Mary Univ London, Antennas & Signal Proc, London, England
Queen Mary Univ London, Whitespace Machine Commun Lab, London, England Queen Mary Univ London, London, England

Li, Geoffrey Ye
论文数: 0 引用数: 0
h-index: 0
机构:
Georgia Inst Technol, Atlanta, GA 30332 USA Queen Mary Univ London, London, England

Nallanathan, Arumugam
论文数: 0 引用数: 0
h-index: 0
机构:
Queen Mary Univ London, Wireless Commun, London, England Queen Mary Univ London, London, England
[8]
On the Performance of Opportunistic NOMA in Downlink CoMP Networks
[J].
Tian, Yue
;
Nix, Andrew R.
;
Beach, Mark
.
IEEE COMMUNICATIONS LETTERS,
2016, 20 (05)
:998-1001

Tian, Yue
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Bristol, Dept Elect & Elect Engn, Commun Syst & Networks Res Grp CSN Grp, Bristol BS8 1UB, Avon, England Univ Bristol, Dept Elect & Elect Engn, Commun Syst & Networks Res Grp CSN Grp, Bristol BS8 1UB, Avon, England

Nix, Andrew R.
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Bristol, Dept Elect & Elect Engn, Commun Syst & Networks Res Grp CSN Grp, Bristol BS8 1UB, Avon, England Univ Bristol, Dept Elect & Elect Engn, Commun Syst & Networks Res Grp CSN Grp, Bristol BS8 1UB, Avon, England

Beach, Mark
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Bristol, Dept Elect & Elect Engn, Commun Syst & Networks Res Grp CSN Grp, Bristol BS8 1UB, Avon, England Univ Bristol, Dept Elect & Elect Engn, Commun Syst & Networks Res Grp CSN Grp, Bristol BS8 1UB, Avon, England
[9]
Spectrum Sharing Planning for Full-Duplex UAV Relaying Systems With Underlaid D2D Communications
[J].
Wang, Haichao
;
Wang, Jinlong
;
Ding, Guoru
;
Chen, Jin
;
Li, Yuzhou
;
Han, Zhu
.
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS,
2018, 36 (09)
:1986-1999

Wang, Haichao
论文数: 0 引用数: 0
h-index: 0
机构:
Army Engn Univ PLA, Coll Commun Engn, Nanjing 210007, Jiangsu, Peoples R China Army Engn Univ PLA, Coll Commun Engn, Nanjing 210007, Jiangsu, Peoples R China

Wang, Jinlong
论文数: 0 引用数: 0
h-index: 0
机构:
Army Engn Univ PLA, Coll Commun Engn, Nanjing 210007, Jiangsu, Peoples R China Army Engn Univ PLA, Coll Commun Engn, Nanjing 210007, Jiangsu, Peoples R China

Ding, Guoru
论文数: 0 引用数: 0
h-index: 0
机构:
Army Engn Univ PLA, Coll Commun Engn, Nanjing 210007, Jiangsu, Peoples R China
Southeast Univ, Natl Mobile Commun Res Lab, Nanjing 210096, Jiangsu, Peoples R China Army Engn Univ PLA, Coll Commun Engn, Nanjing 210007, Jiangsu, Peoples R China

Chen, Jin
论文数: 0 引用数: 0
h-index: 0
机构:
Army Engn Univ PLA, Coll Commun Engn, Nanjing 210007, Jiangsu, Peoples R China Army Engn Univ PLA, Coll Commun Engn, Nanjing 210007, Jiangsu, Peoples R China

Li, Yuzhou
论文数: 0 引用数: 0
h-index: 0
机构:
Huazhong Univ Sci & Technol, Sch Elect Informat & Commun, Wuhan 430074, Peoples R China Army Engn Univ PLA, Coll Commun Engn, Nanjing 210007, Jiangsu, Peoples R China

Han, Zhu
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Houston, Dept Elect & Comp Engn, Houston, TX 77004 USA
Kyung Hee Univ, Dept Comp Sci & Engn, Yongin 17104, South Korea Army Engn Univ PLA, Coll Commun Engn, Nanjing 210007, Jiangsu, Peoples R China
[10]
Energy Tradeoff in Ground-to-UAV Communication via Trajectory Design
[J].
Yang, Dingcheng
;
Wu, Qingqing
;
Zeng, Yong
;
Zhang, Rui
.
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY,
2018, 67 (07)
:6721-6726

Yang, Dingcheng
论文数: 0 引用数: 0
h-index: 0
机构:
Nanchang Univ, Sch Informat Engn, Nanchang 330031, Jiangxi, Peoples R China Nanchang Univ, Sch Informat Engn, Nanchang 330031, Jiangxi, Peoples R China

Wu, Qingqing
论文数: 0 引用数: 0
h-index: 0
机构:
Natl Univ Singapore, Dept Elect & Comp Engn, Singapore 117583, Singapore Nanchang Univ, Sch Informat Engn, Nanchang 330031, Jiangxi, Peoples R China

Zeng, Yong
论文数: 0 引用数: 0
h-index: 0
机构:
Natl Univ Singapore, Dept Elect & Comp Engn, Singapore 117583, Singapore Nanchang Univ, Sch Informat Engn, Nanchang 330031, Jiangxi, Peoples R China

Zhang, Rui
论文数: 0 引用数: 0
h-index: 0
机构:
Natl Univ Singapore, Dept Elect & Comp Engn, Singapore 117583, Singapore Nanchang Univ, Sch Informat Engn, Nanchang 330031, Jiangxi, Peoples R China