Software-Defined Vehicular Networks With Trust Management: A Deep Reinforcement Learning Approach

被引:44
作者
Zhang, Dajun [1 ]
Yu, F. Richard [1 ]
Yang, Ruizhe [2 ]
Zhu, Li [3 ]
机构
[1] Carleton Univ, Dept Syst & Comp Engn, Ottawa, ON K1S 5B6, Canada
[2] Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
[3] Beijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R China
基金
加拿大自然科学与工程研究理事会;
关键词
Vehicular networks; SDN; ad-hoc network; deep Q-learning; expected transmission count; trust model; ANOMALY DETECTION; FUZZY-LOGIC; SDN; SECURITY; INTERNET; VEHICLES; SCHEME;
D O I
10.1109/TITS.2020.3025684
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
The appropriate design of a vehicular ad hoc network (VANET) has become a pivotal way to build an efficient smart transportation system. which enables various applications associated with traffic safety and highly-efficient transportation. VANETs are vulnerable to the threat of malicious nodes stemming from its dynamicity and infrastructure-less nature and causing performance degradation. Recently, software-defined networking (SDN) has provided a feasible way to manage VANETs dynamically. In this article, we propose a novel software-defined trust based VANET architecture (SD-TDQL) in which the centralized SUN controller is served as a learning agent to get the optimal communication link policy using a deep Q-learning approach. The trust of each vehicle and the reverse delivery ratio are considered in a joint optimization problem, which is modeled as a Markov decision process with state space, action space, and reward function. Specifically, we use the expected transmission count (ETX) as a metric to evaluate the quality of the communication link for the connected vehicles' communication. Moreover, we design a trust model to avoid the bad influence of malicious vehicles. Simulation results prove that the proposed SD-TDQL framework enhances the link quality.
引用
收藏
页码:1400 / 1414
页数:15
相关论文
共 42 条
[1]  
Abadi M., 2016, TENSORFLOW LARGE SCA
[2]   Cyber security challenges and solutions for V2X communications: A survey [J].
Alnasser, Aljawharah ;
Sun, Hongjian ;
Jian, Jing .
COMPUTER NETWORKS, 2019, 151 :52-67
[3]   Fuzzy Logic-Based Geographic Routing for Urban Vehicular Networks Using Link Quality and Achievable Throughput Estimations [J].
Alzamzami, Ohoud ;
Mahgoub, Imad .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2019, 20 (06) :2289-2300
[4]  
[Anonymous], 2003, P INT C MOB COMP NET, DOI DOI 10.1145/938985.939000
[5]   EVaaS: Electric vehicle-as-a-service for energy trading in SDN-enabled smart transportation system [J].
Aujla, Gagangeet Singh ;
Jindal, Anish ;
Kumar, Neeraj .
COMPUTER NETWORKS, 2018, 143 :247-262
[6]   Adaptive Opportunistic Routing for Wireless Ad Hoc Networks [J].
Bhorkar, Abhijeet A. ;
Naghshvar, Mohammad ;
Javidi, Tara ;
Rao, Bhaskar D. .
IEEE-ACM TRANSACTIONS ON NETWORKING, 2012, 20 (01) :243-256
[7]   A secure and trust based on-demand multipath routing scheme for self-organized mobile ad-hoc networks [J].
Borkar, Gautam M. ;
Mahajan, A. R. .
WIRELESS NETWORKS, 2017, 23 (08) :2455-2472
[8]  
Cheng XM, 2018, 2018 CHINA SEMICONDUCTOR TECHNOLOGY INTERNATIONAL CONFERENCE (CSTIC)
[9]   Dynamic fuzzy logic and reinforcement learning for adaptive energy efficient routing in mobile ad-hoc networks [J].
Chettibi, Saloua ;
Chikhi, Salim .
APPLIED SOFT COMPUTING, 2016, 38 :321-328
[10]  
Chilimbi Trishul, 2014, Proceedings of the 11th USENIX Symposium on Operating Systems Design and Implementation (OSDI '14). OSDI '14, P571