Multi-Agent Deep Reinforcement Learning for Packet Routing in Tactical Mobile Sensor Networks

被引:10
作者
Okine, Andrews A. [1 ]
Adam, Nadir [1 ]
Naeem, Faisal [1 ]
Kaddoum, Georges [1 ,2 ]
机构
[1] Univ Quebec, Ecole Technol Super, Elect Engn Dept, Montreal, PQ H3C 1K3, Canada
[2] Lebanese Amer Univ, Artificial Intelligence & Cyber Syst Res Ctr, Beirut 11022801, Lebanon
来源
IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT | 2024年 / 21卷 / 02期
关键词
Routing; wireless sensor networks; tactical wireless networks; deep reinforcement learning; jamming; PROTOCOL; ENERGY;
D O I
10.1109/TNSM.2024.3352014
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Tactical wireless sensor networks (T-WSNs) are used in critical data-gathering military operations, such as battlefield surveillance, combat monitoring, and intrusion detection. These networks have unique challenges, such as jamming attacks, which are not normally encountered in traditional WSNs. Jamming attacks on the networks' links disrupt data communication and make packet routing in T-WSNs a difficult task. Consequently, T-WSN routing aims to find the most reliable routes, while meeting the stringent delay and energy requirements. To this end, we propose a distributed multi-agent deep reinforcement learning (MADRL)-based routing solution for multi-sink tactical mobile sensor networks to overcome link layer jamming attacks. Our proposed routing scheme captures the hop count to the nearest sink, the one-hop delay, the next hop's packet loss rate (PLR), and the energy cost of packet forwarding in the action reward estimation. Furthermore, the proposed scheme outperforms benchmark algorithms in terms of the packet delivery ratio (PDR), packet delivery time, and energy efficiency.
引用
收藏
页码:2155 / 2169
页数:15
相关论文
共 62 条
[41]   EER-RL: Energy-Efficient Routing Based on Reinforcement Learning [J].
Mutombo, Vially Kazadi ;
Lee, Seungyeon ;
Lee, Jusuk ;
Hong, Jiman .
MOBILE INFORMATION SYSTEMS, 2021, 2021
[42]  
Nguyen S. T., 2009, PROC IEEE MIL COMMUN, P1
[43]   A Lifetime-Aware Centralized Routing Protocol for Wireless Sensor Networks using Reinforcement Learning [J].
Obi, Elvis ;
Mammeri, Zoubir ;
Ochia, Okechukwu E. .
2021 17TH INTERNATIONAL CONFERENCE ON WIRELESS AND MOBILE COMPUTING, NETWORKING AND COMMUNICATIONS (WIMOB 2021), 2021, :363-368
[44]   Reinforcement Learning Aided Routing in Tactical Wireless Sensor Networks [J].
Okine, Andrews A. ;
Adam, Nadir ;
Kaddoum, Georges .
UBIQUITOUS NETWORKING, UNET 2022, 2023, 13853 :211-224
[45]   Low-Latency and Energy-Balanced Data Transmission Over Cognitive Small World WSN [J].
Pandey, Om Jee ;
Hegde, Rajesh M. .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2018, 67 (08) :7719-7733
[46]   A Continuous Actor-Critic Deep Q-Learning-Enabled Deployment of UAV Base Stations: Toward 6G Small Cells in the Skies of Smart Cities [J].
Parvaresh, Nahid ;
Kantarci, Burak .
IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2023, 4 :700-712
[47]  
Raschka S., 2022, Machine learning with pytorch and Scikit-Learn: Develop machine learning and deep learning models with scikit-learn and pytorch
[48]   MeFi: Mean Field Reinforcement Learning for Cooperative Routing in Wireless Sensor Network [J].
Ren, Jing ;
Zheng, Jiangong ;
Guo, Xiaotong ;
Song, Tongyu ;
Wang, Xiong ;
Wang, Sheng ;
Zhang, Wei .
IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (01) :995-1011
[49]  
Rittong C., 2011, 2011 Proceedings of IEEE/IFIP 9th International Conference on Embedded and Ubiquitous Computing (EUC 2011), P320, DOI 10.1109/EUC.2011.45
[50]   A Q-Learning-Based Routing Approach for Energy Efficient Information Transmission in Wireless Sensor Network [J].
Su, Xing ;
Ren, Yiting ;
Cai, Zhi ;
Liang, Yi ;
Guo, Limin .
IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2023, 20 (02) :1949-1961