Large field monitoring system of vehicle load on long-span bridge based on the fusion of multiple vision and WIM data

被引:17
作者
Dong, Yiqing [1 ]
Wang, Dalei [1 ,2 ]
Pan, Yue [3 ]
Ma, Yunlong [1 ]
机构
[1] Tongji Univ, Coll Civil Engn, Shanghai, Peoples R China
[2] Tongji Univ, Key Lab Performance Evolut & Control Engn Struct, Minist Educ, Shanghai, Peoples R China
[3] Tongji Univ, Coll Elect & Informat Engn, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
Spatial -temporal vehicle load; Long -span bridge; Computer vision; Vehicle detection and tracking; Data fusion; COMPUTER VISION; IDENTIFICATION;
D O I
10.1016/j.autcon.2023.104985
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Vehicle Load Monitoring (VLM) on entire long-span bridge decks presents significant challenges due to the spatial and temporal randomness of vehicles. Existing VLM systems often suffer from limited viewing coverage and poor continuity of multi-vehicle tracking methods. This paper proposes a VLM system consisting of multivision image pre-processing, modified YOLO-v4 model, kinematics-enhanced vehicle tracking algorithm, and data fusion method between vision and Weigh-In-Motion sub-systems. The system was tested on a long-span bridge using six cameras, achieving vehicle monitoring of entire deck. The precision of multi-vehicle tracking achieved 99.28% built upon YOLO-v4 model with 96.2% mean Average Precision (mAP). Comparative results demonstrate that the modified YOLO-v4 model outperforms state-of-the-art approaches, and our proposed tracking method surpasses other methods. Our proposed system offers a comprehensive solution for VLM on entire bridge deck, overcoming the limitations of existing methods. Future work could extend the system's capability to include complex traffic patterns.
引用
收藏
页数:17
相关论文
共 54 条
[1]  
Abadi Martin, 2016, arXiv
[2]   Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics [J].
Bernardin, Keni ;
Stiefelhagen, Rainer .
EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2008, 2008 (1)
[3]  
Bewley A, 2016, IEEE IMAGE PROC, P3464, DOI 10.1109/ICIP.2016.7533003
[4]  
Bochkovskiy A, 2020, Arxiv, DOI arXiv:2004.10934
[5]   Automatic panoramic image stitching using invariant features [J].
Brown, Matthew ;
Lowe, David G. .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2007, 74 (01) :59-73
[6]   Identification of spatio-temporal distribution of vehicle loads on long-span bridges using computer vision technology [J].
Chen, Zhicheng ;
Li, Hui ;
Bao, Yuequan ;
Li, Na ;
Jin, Yao .
STRUCTURAL CONTROL & HEALTH MONITORING, 2016, 23 (03) :517-534
[7]   Histograms of oriented gradients for human detection [J].
Dalal, N ;
Triggs, B .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2005, :886-893
[8]   Digital Twin System of Bridges Group Based on Machine Vision Fusion Monitoring of Bridge Traffic Load [J].
Dan, Danhui ;
Ying, Yufeng ;
Ge, Liangfu .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (11) :22190-22205
[9]   Identification of moving loads based on the information fusion of weigh-in-motion system and multiple camera machine vision [J].
Dan, Danhui ;
Ge, Liangfu ;
Yan, Xingfei .
MEASUREMENT, 2019, 144 :155-166
[10]   The Way They Move: Tracking Multiple Targets with Similar Appearance [J].
Dicle, Caglayan ;
Camps, Octavia I. ;
Sznaier, Mario .
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, :2304-2311