A Dual Transformer Super-Resolution Network for Improving the Definition of Vibration Image

被引:4
|
作者
Zhu, Yang [1 ]
Wang, Sen [1 ]
Zhang, Yinhui [1 ]
He, Zifen [1 ]
Wang, Qingjian [1 ]
机构
[1] Kunming Univ Sci & Technol, Fac Mech & Elect Engn, Kunming 650500, Peoples R China
基金
中国国家自然科学基金;
关键词
Vibrations; Transformers; Superresolution; Feature extraction; Image reconstruction; Task analysis; Displacement measurement; Attention mechanism; computer vision; image super-resolution; transformer; visual vibration measurement;
D O I
10.1109/TIM.2022.3222503
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Visual measurement methods are gaining more and more attention in the field of structural body health monitoring due to the advantages of long-range, noncontact, and multipoint monitoring. However, the imaging system is usually affected by many factors, such as distortion, blurring, and noise, which lead to displacement measurement errors after the degradation of the acquired image quality. Therefore, in this article, we propose a structural body image super-resolution network based on a dual transformer architecture to improve the clarity of the collected structural body vibration displacement image to better capture the vibration displacement information of the target. Meanwhile, we design a dual transformer block based on an encoder-decoder architecture for the characteristics of vision-based structural body vibration displacement measurement tasks to better extract structural body image details and edge feature information. In this module, we introduce two different transformers. In addition, modules based on the encoder-decoder architecture focus more on the input and output image information and often ignore the feature information in different layers. Therefore, we introduce an attention mechanism in the network and interact with the feature information in different layers of the encoder-decoder architecture to obtain a better structural body image super-resolution effect. After comparison tests with the rest of the latest and most classical networks as well as the current optimal networks, it is shown that our network obtains excellent image reconstruction results under different structural body vibration image datasets (SETs), which also provides a strong guarantee for the task of accurate vision-based structural body vibration displacement measurement.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Structured image super-resolution network based on improved Transformer
    Lv X.-D.
    Li J.
    Deng Z.-N.
    Feng H.
    Cui X.-T.
    Deng H.-X.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2023, 57 (05): : 865 - 874+910
  • [42] TTSR: A Transformer-Based Topography Neural Network for Digital Elevation Model Super-Resolution
    Wang, Yi
    Jin, Shichao
    Yang, Zekun
    Guan, Hongcan
    Ren, Yu
    Cheng, Kai
    Zhao, Xiaoqian
    Liu, Xiaoqiang
    Chen, Mengxi
    Liu, Yu
    Guo, Qinghua
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 19
  • [43] Spatial Transformer Generative Adversarial Network for Image Super-Resolution
    Rempakos, Pantelis
    Vrigkas, Michalis
    Plissiti, Marina E.
    Nikou, Christophoros
    IMAGE ANALYSIS AND PROCESSING, ICIAP 2023, PT I, 2023, 14233 : 399 - 411
  • [44] Transformer and GAN-Based Super-Resolution Reconstruction Network for Medical Images
    Du, Weizhi
    Tian, Shihao
    TSINGHUA SCIENCE AND TECHNOLOGY, 2024, 29 (01): : 197 - 206
  • [45] Joint image deblurring and super-resolution with attention dual supervised network
    Zhang, Dongyang
    Liang, Zhenwen
    Shao, Jie
    NEUROCOMPUTING, 2020, 412 (412) : 187 - 196
  • [46] Efficient Adaptive Feature Fusion Network for Remote-Sensing Image Super-Resolution
    Hao, Shuai
    Liu, Shuai
    Jia, Xu
    Lu, Huchuan
    He, You
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 3089 - 3093
  • [47] Spstnet: image super-resolution using spatial pyramid swin transformer network
    Sun, Yemei
    Wang, Jiao
    Yang, Yue
    Zhang, Yan
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (04)
  • [48] A Two-Stage Attentive Network for Single Image Super-Resolution
    Zhang, Jiqing
    Long, Chengjiang
    Wang, Yuxin
    Piao, Haiyin
    Mei, Haiyang
    Yang, Xin
    Yin, Baocai
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (03) : 1020 - 1033
  • [49] CVIformer: Cross-View Interactive Transformer for Efficient Stereoscopic Image Super-Resolution
    Zhang, Dongyang
    Liang, Shuang
    He, Tao
    Shao, Jie
    Qin, Ke
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, : 1107 - 1118
  • [50] StructureColor Preserving Network for Hyperspectral Image Super-Resolution
    Pan, Bin
    Qu, Qiaoying
    Xu, Xia
    Shi, Zhenwei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60