Efficient matching of Transformer-enhanced features for accurate vision-based displacement measurement

被引:0
作者
Zhang, Haoyu [1 ,2 ]
Wu, Stephen [3 ,4 ]
Luo, Xiangyun [1 ,2 ]
Huang, Yong [1 ,2 ]
Li, Hui [1 ,2 ]
机构
[1] Harbin Inst Technol, Minist Ind & Informat Technol, Key Lab Smart Prevent & Mitigat Civil Engn Disaste, Harbin 150090, Peoples R China
[2] Harbin Inst Technol, Sch Civil Engn, Key Lab Struct Dynam Behav & Control, Minist Educ, Harbin 150090, Peoples R China
[3] Inst Stat Math, Res Org Informat & Syst, 10-3 Midori Cho, Tachikawa, Tokyo 1908562, Japan
[4] Grad Univ Adv Studies SOKENDAI, 10-3 Midori Cho, Tachikawa, Tokyo 1908562, Japan
基金
中国国家自然科学基金;
关键词
Attention mechanism; Subpixel feature matching; Transformer; Computer vision; Displacement measurement; Vibration monitoring; LEARNING OPTICAL-FLOW; DYNAMIC DISPLACEMENT; CIVIL INFRASTRUCTURE; COMPUTER VISION; ACCELERATION; PERFORMANCE; VELOCITY; FUSION; BRIDGE;
D O I
10.1016/j.autcon.2025.105962
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Computer vision technology and monitoring videos have been employed to obtain structural displacement measurements. Noniterative algorithms are mainly designed for rapid tracking of the motions of individual image points, rather than dense motion fields. Iterative algorithms are limited to estimating motion fields with small amplitudes and require high computation cost to achieve high accuracy. This paper introduces a non- iterative method for vision-based measurements that balances speed and density. The method employs an attention-based matching strategy applied to Transformer-enhanced image features. Motion priors and a physics- informed denoising approach are integrated to improve measurement accuracy. Tested on challenging truss and cable-stayed bridge vibration videos, the method demonstrated superior displacement measurement performance compared to conventional approaches. It also achieved greater robustness to brightness changes and partial occlusions while requiring minimal human intervention. This method supports the development of automated and affordable vibration monitoring systems.
引用
收藏
页数:18
相关论文
共 68 条
  • [1] A review of vibration-based damage detection in civil structures: From traditional methods to Machine Learning and Deep Learning applications
    Avci, Onur
    Abdeljaber, Osama
    Kiranyaz, Serkan
    Hussein, Mohammed
    Gabbouj, Moncef
    Inman, Daniel J.
    [J]. MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2021, 147
  • [2] PERFORMANCE OF OPTICAL-FLOW TECHNIQUES
    BARRON, JL
    FLEET, DJ
    BEAUCHEMIN, SS
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 1994, 12 (01) : 43 - 77
  • [3] Excessive Long-Time Deflections of Prestressed Box Girders. I: Record-Span Bridge in Palau and Other Paradigms
    Bazant, Zdenek P.
    Yu, Qiang
    Li, Guang-Hua
    [J]. JOURNAL OF STRUCTURAL ENGINEERING-ASCE, 2012, 138 (06): : 676 - 686
  • [4] Spatiotemporal compressive sensing of full-field Lagrangian continuous displacement response from optical flow of edge: Identification of full-field dynamic modes
    Bhowmick, Sutanu
    Nagarajaiah, Satish
    [J]. MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2022, 164
  • [5] Birchfield S., KLT : An implementation of the kanade-lucas-tomasi feature tracker
  • [6] Analog-to-digital conversion as a source of drifts in displacements derived from digital recordings of ground acceleration
    Boore, DM
    [J]. BULLETIN OF THE SEISMOLOGICAL SOCIETY OF AMERICA, 2003, 93 (05) : 2017 - 2024
  • [7] Brunelli R., 2009, TEMPLATE MATCHING TE
  • [8] Sensitivity of fundamental mode shape and static deflection for damage identification in cantilever beams
    Cao, Maosen
    Ye, Lin
    Zhou, Limin
    Su, Zhongqing
    Bai, Runbo
    [J]. MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2011, 25 (02) : 630 - 643
  • [9] Lightweight and Optimization Acceleration Methods for Vision Transformer: A Review
    Chen, Meng
    Gao, Jun
    Yu, Wuxin
    [J]. 2022 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2022, : 2154 - 2160
  • [10] SegFlow: Joint Learning for Video Object Segmentation and Optical Flow
    Cheng, Jingchun
    Tsai, Yi-Hsuan
    Wang, Shengjin
    Yang, Ming-Hsuan
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 686 - 695