A deep neural network-based vehicle re-identification method for bridge load monitoring

被引:8
作者
Zhang, Yufeng [1 ,2 ]
Xie, Junxin [3 ]
Peng, Jiayi [1 ,2 ]
Li, Hui [3 ]
Huang, Yong [3 ]
机构
[1] Jiangsu Transportat Res Inst, State Key Lab Safety & Hlth Serv Long Span Bridge, Nanjing, Peoples R China
[2] Observat & Res Base Transport Ind Struct Safety &, Nanjing, Peoples R China
[3] Harbin Inst Technol, Sch Civil Engn, Minist Ind & Informat Technol, Key Lab Smart Prevent & Mitigat Civil Engn Disast, Harbin, Peoples R China
基金
中国国家自然科学基金;
关键词
vehicle re-identification; feature descriptor; computer vision; deep learning; bridge load monitoring; IMAGE; IDENTIFICATION; INFORMATION; TECHNOLOGY; SYSTEM;
D O I
10.1177/13694332211033956
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
The accurate tracking of vehicle loads is essential for the condition assessment of bridge structures. In recent years, a computer vision method that is based on multiple sources of data from monitoring cameras and weight-in-motion (WIM) systems has become a promising strategy in bridge vehicle load identification for structural health monitoring (SHM) and has attracted increasing attention. The implementation of vehicle re-identification, namely, the identification of the same vehicle from images that were captured at different locations or time instants, is the key topic of this study. In this study, a vehicle re-identification method that is based on HardNet, a deep convolutional neural network (CNN) specialized in picking up local image features, is proposed. First, we obtain the vehicle point feature positions in the image through feature detection. Then, the HardNet is employed to encode the point feature image patches into deep learning feature descriptors. Re-identification of the target vehicle is achieved by matching the encoded descriptors between two images, which are robust toward scaling, rotation, and other types of noises. A comparison study of the proposed method with three published vehicle re-identification methods is performed using vehicle image data from a real bridge, and the superior performance of our proposed method is demonstrated.
引用
收藏
页码:3691 / 3706
页数:16
相关论文
共 43 条
[1]  
Andrew A. M., 2001, Kybernetes, V30, P1333, DOI [10.1108/k.2001.30.9_10.1333.2, DOI 10.1108/K.2001.30.9_10.1333.2]
[2]   Group-Sensitive Triplet Embedding for Vehicle Reidentification [J].
Bai, Yan ;
Lou, Yihang ;
Gao, Feng ;
Wang, Shiqi ;
Wu, Yuwei ;
Duan, Ling-Yu .
IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (09) :2385-2399
[3]   HPatches: A benchmark and evaluation of handcrafted and learned local descriptors [J].
Balntas, Vassileios ;
Lenc, Karel ;
Vedaldi, Andrea ;
Mikolajczyk, Krystian .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :3852-3861
[4]  
Brown Lisa M., 2010, Proceedings 7th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS 2010), P91, DOI 10.1109/AVSS.2010.59
[5]   Automatic panoramic image stitching using invariant features [J].
Brown, Matthew ;
Lowe, David G. .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2007, 74 (01) :59-73
[6]   Modelling the spatial distribution of heavy vehicle loads on long-span bridges based on undirected graphical model [J].
Chen, Zhicheng ;
Bao, Yuequan ;
Chen, Jiahui ;
Li, Hui .
STRUCTURE AND INFRASTRUCTURE ENGINEERING, 2019, 15 (11) :1485-1499
[7]   Identification of spatio-temporal distribution of vehicle loads on long-span bridges using computer vision technology [J].
Chen, Zhicheng ;
Li, Hui ;
Bao, Yuequan ;
Li, Na ;
Jin, Yao .
STRUCTURAL CONTROL & HEALTH MONITORING, 2016, 23 (03) :517-534
[8]   Identification of moving loads based on the information fusion of weigh-in-motion system and multiple camera machine vision [J].
Dan, Danhui ;
Ge, Liangfu ;
Yan, Xingfei .
MEASUREMENT, 2019, 144 :155-166
[9]   Structural displacement monitoring using deep learning-based full field optical flow methods [J].
Dong, Chuan-Zhi ;
Celik, Ozan ;
Catbas, F. Necati ;
O'Brien, Eugene J. ;
Taylor, Su .
STRUCTURE AND INFRASTRUCTURE ENGINEERING, 2020, 16 (01) :51-71
[10]   A non-target structural displacement measurement method using advanced feature matching strategy [J].
Dong, Chuan-Zhi ;
Catbas, F. Necati .
ADVANCES IN STRUCTURAL ENGINEERING, 2019, 22 (16) :3461-3472