Multi-Agent Deep Reinforcement Learning for Packet Routing in Tactical Mobile Sensor Networks

被引:10
作者
Okine, Andrews A. [1 ]
Adam, Nadir [1 ]
Naeem, Faisal [1 ]
Kaddoum, Georges [1 ,2 ]
机构
[1] Univ Quebec, Ecole Technol Super, Elect Engn Dept, Montreal, PQ H3C 1K3, Canada
[2] Lebanese Amer Univ, Artificial Intelligence & Cyber Syst Res Ctr, Beirut 11022801, Lebanon
来源
IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT | 2024年 / 21卷 / 02期
关键词
Routing; wireless sensor networks; tactical wireless networks; deep reinforcement learning; jamming; PROTOCOL; ENERGY;
D O I
10.1109/TNSM.2024.3352014
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Tactical wireless sensor networks (T-WSNs) are used in critical data-gathering military operations, such as battlefield surveillance, combat monitoring, and intrusion detection. These networks have unique challenges, such as jamming attacks, which are not normally encountered in traditional WSNs. Jamming attacks on the networks' links disrupt data communication and make packet routing in T-WSNs a difficult task. Consequently, T-WSN routing aims to find the most reliable routes, while meeting the stringent delay and energy requirements. To this end, we propose a distributed multi-agent deep reinforcement learning (MADRL)-based routing solution for multi-sink tactical mobile sensor networks to overcome link layer jamming attacks. Our proposed routing scheme captures the hop count to the nearest sink, the one-hop delay, the next hop's packet loss rate (PLR), and the energy cost of packet forwarding in the action reward estimation. Furthermore, the proposed scheme outperforms benchmark algorithms in terms of the packet delivery ratio (PDR), packet delivery time, and energy efficiency.
引用
收藏
页码:2155 / 2169
页数:15
相关论文
共 62 条
[1]   RLBEEP: Reinforcement-Learning-Based Energy Efficient Control and Routing Protocol for Wireless Sensor Networks [J].
Abadi, Ali Forghani Elah ;
Asghari, Seyyed Amir ;
Marvasti, Mohammadreza Binesh ;
Abaei, Golnoush ;
Nabavi, Morteza ;
Savaria, Yvon .
IEEE ACCESS, 2022, 10 :44123-44135
[2]   Intelligent Fault-Tolerance Data Routing Scheme for IoT-Enabled WSNs [J].
Agarwal, Vaibhav ;
Tapaswi, Shashikala ;
Chanak, Prasenjit .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (17) :16332-16342
[3]   Hierarchical Deep Double Q-Routing [J].
Ali, Ramy E. ;
Erman, Bilgehan ;
Bastug, Ejder ;
Cilli, Bruce .
ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
[4]   Dynamic directional routing for mobile wireless sensor networks [J].
Almesaeed, Reham ;
Jedidi, Ahmed .
AD HOC NETWORKS, 2021, 110
[5]   A Deep Reinforcement Learning-Based Geographic Packet Routing Optimization [J].
Bai, Yijie ;
Zhang, Xia ;
Yu, Daojie ;
Li, Shengxiang ;
Wang, Yu ;
Lei, Shuntian ;
Tian, Zhoutai .
IEEE ACCESS, 2022, 10 :108785-108796
[6]   Distributed Cooperative Reinforcement Learning for Wireless Sensor Network Routing [J].
Barker, Adam ;
Swany, Martin .
2022 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2022, :2565-2570
[7]   Dealing With Changes: Resilient Routing via Graph Neural Networks and Multi-Agent Deep Reinforcement Learning [J].
Bhavanasi, Sai Shreyas ;
Pappone, Lorenzo ;
Esposito, Flavio .
IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2023, 20 (03) :2283-2294
[8]   Link-Quality Aware Path Selection in the Presence of Proactive Jamming in Fallible Wireless Sensor Networks [J].
Bhavathankar, Prasenjit ;
Chatterjee, Subarna ;
Misra, Sudip .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2018, 66 (04) :1689-1704
[9]   Efficient Routing Protocol for Wireless Sensor Network based on Reinforcement Learning [J].
Bouzid, S. E. ;
Serrestou, Y. ;
Raoof, K. ;
Omri, M. N. .
2020 5TH INTERNATIONAL CONFERENCE ON ADVANCED TECHNOLOGIES FOR SIGNAL AND IMAGE PROCESSING (ATSIP'2020), 2020,
[10]  
BOYAJIAN James C., 1993, Portuguese Trade in Asia under the Habsburgs, 1580-1640, P1