Deep Reinforcement Learning for Communication Flow Control in Wireless Mesh Networks

被引:60
|
作者
Liu, Qingzhi [1 ]
Cheng, Long [2 ]
Jia, Adele Lu [3 ]
Liu, Cong [4 ]
机构
[1] Wageningen Univ & Res, Informat Technol Grp, Wageningen, Netherlands
[2] North China Elect Power Univ, Sch Control & Comp Engn, Beijing, Peoples R China
[3] China Agr Univ, Comp Sci Dept, Beijing, Peoples R China
[4] Shandong Univ Technol, Sch Comp Sci & Technol, Zibo, Peoples R China
来源
IEEE NETWORK | 2021年 / 35卷 / 02期
基金
中国国家自然科学基金;
关键词
Training; Data models; Wireless networks; Throughput; Network topology; Adaptation models; Wireless mesh networks; ACCESS;
D O I
10.1109/MNET.011.2000303
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Wireless mesh network (WMN) is one of the most promising technologies for Internet of Things (IoT) applications because of its self-adaptive and self-organization nature. To meet different performance requirements on communications in WMNs, traditional approaches always have to program flow control strategies in an explicit way. In this case, the performance of WMNs will be significantly affected by the dynamic properties of underlying networks in real applications. With providing a more flexible solution in mind, in this article, for the first time, we present how we can apply emerging Deep Reinforcement Learning (DRL) on communication flow control in WMNs. Moreover, different from a general DRL based networking solution, in which the network properties are pre-defined, we leverage the adaptive nature of WMNs and propose a self-adaptive DRL approach. Specifically, our method can reconstruct a WMN during the training of a DRL model. In this way, the trained DRL model can capture more properties of WMNs and achieve better performance. As a proof of concept, we have implemented our method with a self-adap-tive Deep Q-learning Network (DQN) model. The evaluation results show that the presented solution can significantly improve the communication performance of data flows in WMNs, compared to a static benchmark solution.
引用
收藏
页码:112 / 119
页数:8
相关论文
empty
未找到相关数据