Optimizing Age of Information in RIS-Assisted NOMA Networks: A Deep Reinforcement Learning Approach

被引:14
作者
Feng, Xue [1 ]
Fu, Shu [1 ]
Fang, Fang [2 ,3 ]
Yu, Fei Richard [4 ]
机构
[1] Chongqing Univ, Dept Microelect & Commun Engn, Chongqing 400044, Peoples R China
[2] Western Univ, Dept Elect & Comp Engn, London, ON N6A 3K7, Canada
[3] Western Univ, Dept Comp Sci, London, ON N6A 3K7, Canada
[4] Carleton Univ, Dept Syst & Comp Engn, Ottawa, ON K1S 5B6, Canada
基金
中国国家自然科学基金;
关键词
NOMA; Optimization; Internet of Things; Interference; Signal to noise ratio; Information age; Wireless sensor networks; Reconfigurable intelligent surface; age of information; deep reinforcement learning; non-orthogonal multiple access; RECONFIGURABLE INTELLIGENT SURFACES;
D O I
10.1109/LWC.2022.3193958
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Due to the rapid development of the Internet of Things (IoT), data freshness has become particularly important. In this letter, we study a reconfigurable intelligent surface (RIS) assisted non-orthogonal multiple access (NOMA) network for collecting packets of IoT devices. Specifically, we establish a novel age of information (AoI) model to evaluate the freshness of packets. To minimize the average peak AoI, we formulate an optimization problem of jointly optimizing the phase-shift matrix of RIS and service time of packets. Then, we adopt deep deterministic policy gradient (DDPG) to solve the non-convex problem, which can handle a mass of continuous high-dimensional variables. Extensive simulation results demonstrate the superiority of the proposed scheme compared to the conventional schemes.
引用
收藏
页码:2100 / 2104
页数:5
相关论文
共 15 条
[1]   On the Role of Age of Information in the Internet of Things [J].
Abd-Elmagid, Mohamed A. ;
Pappas, Nikolaos ;
Dhillon, Arpreet S. .
IEEE COMMUNICATIONS MAGAZINE, 2019, 57 (12) :72-77
[2]   Average Peak Age-of-Information Minimization in UAV-Assisted IoT Networks [J].
Abd-Elmagid, Mohamed A. ;
Dhillon, Harpreet S. .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (02) :2003-2008
[3]   Reconfigurable Intelligent Surfaces for Rich Scattering Wireless Communications: Recent Experiments, Challenges, and Opportunities [J].
Alexandropoulos, George C. ;
Shlezinger, Nir ;
del Hougne, Philipp .
IEEE COMMUNICATIONS MAGAZINE, 2021, 59 (06) :28-34
[4]   Age of Information With Joint Packet Coding in Industrial IoT [J].
Chan, Tse-Tin ;
Pan, Haoyuan ;
Liang, Jiaxin .
IEEE WIRELESS COMMUNICATIONS LETTERS, 2021, 10 (11) :2499-2503
[5]   Energy-Efficient Design of IRS-NOMA Networks [J].
Fang, Fang ;
Xu, Yanqing ;
Quoc-Viet Pham ;
Ding, Zhiguo .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (11) :14088-14092
[6]   AoI-Minimal Trajectory Planning and Data Collection in UAV-Assisted Wireless Powered IoT Networks [J].
Hu, Huimin ;
Xiong, Ke ;
Qu, Gang ;
Ni, Qiang ;
Fan, Pingyi ;
Ben Letaief, Khaled .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (02) :1211-1223
[7]   Moment Generating Function of the AoI in a Two-Source System With Packet Management [J].
Moltafet, Mohammad ;
Leinonen, Markus ;
Codreanu, Marian .
IEEE WIRELESS COMMUNICATIONS LETTERS, 2021, 10 (04) :882-886
[8]   Optimizing Age of Information Through Aerial Reconfigurable Intelligent Surfaces: A Deep Reinforcement Learning Approach [J].
Samir, Moataz ;
Elhattab, Mohamed ;
Assi, Chadi ;
Sharafeddine, Sanaa ;
Ghrayeb, Ali .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (04) :3978-3983
[9]   Optimizing Information Freshness via Multiuser Scheduling With Adaptive NOMA/OMA [J].
Wang, Qian ;
Chen, He ;
Zhao, Changhong ;
Li, Yonghui ;
Popovski, Petar ;
Vucetic, Branka .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (03) :1766-1778
[10]   Towards Smart and Reconfigurable Environment: Intelligent Reflecting Surface Aided Wireless Network [J].
Wu, Qingqing ;
Zhang, Rui .
IEEE COMMUNICATIONS MAGAZINE, 2020, 58 (01) :106-112