A Dual Transformer Super-Resolution Network for Improving the Definition of Vibration Image

被引:4
|
作者
Zhu, Yang [1 ]
Wang, Sen [1 ]
Zhang, Yinhui [1 ]
He, Zifen [1 ]
Wang, Qingjian [1 ]
机构
[1] Kunming Univ Sci & Technol, Fac Mech & Elect Engn, Kunming 650500, Peoples R China
基金
中国国家自然科学基金;
关键词
Vibrations; Transformers; Superresolution; Feature extraction; Image reconstruction; Task analysis; Displacement measurement; Attention mechanism; computer vision; image super-resolution; transformer; visual vibration measurement;
D O I
10.1109/TIM.2022.3222503
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Visual measurement methods are gaining more and more attention in the field of structural body health monitoring due to the advantages of long-range, noncontact, and multipoint monitoring. However, the imaging system is usually affected by many factors, such as distortion, blurring, and noise, which lead to displacement measurement errors after the degradation of the acquired image quality. Therefore, in this article, we propose a structural body image super-resolution network based on a dual transformer architecture to improve the clarity of the collected structural body vibration displacement image to better capture the vibration displacement information of the target. Meanwhile, we design a dual transformer block based on an encoder-decoder architecture for the characteristics of vision-based structural body vibration displacement measurement tasks to better extract structural body image details and edge feature information. In this module, we introduce two different transformers. In addition, modules based on the encoder-decoder architecture focus more on the input and output image information and often ignore the feature information in different layers. Therefore, we introduce an attention mechanism in the network and interact with the feature information in different layers of the encoder-decoder architecture to obtain a better structural body image super-resolution effect. After comparison tests with the rest of the latest and most classical networks as well as the current optimal networks, it is shown that our network obtains excellent image reconstruction results under different structural body vibration image datasets (SETs), which also provides a strong guarantee for the task of accurate vision-based structural body vibration displacement measurement.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] A CNN-transformer hybrid network with selective fusion and dual attention for image super-resolution
    Zhang, Chun
    Wang, Jin
    Shi, Yunhui
    Yin, Baocai
    Ling, Nam
    MULTIMEDIA SYSTEMS, 2025, 31 (02)
  • [22] Multiframe Super-Resolution With Dual Pyramid Multiattention Network for Droplet Measurement
    Liu, Qiangqiang
    Yang, Hua
    Chen, Jiankui
    Yin, Zhouping
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [23] Adaptive Feature Selection Modulation Network for Efficient Image Super-Resolution
    Wu, Chen
    Wang, Ling
    Su, Xin
    Zheng, Zhuoran
    IEEE SIGNAL PROCESSING LETTERS, 2025, 32 : 1231 - 1235
  • [24] Exploring Frequency-Inspired Optimization in Transformer for Efficient Single Image Super-Resolution
    Li, Ao
    Zhang, Le
    Liu, Yun
    Zhu, Ce
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2025, 47 (04) : 3141 - 3158
  • [25] SCTANet: A Spatial Attention-Guided CNN-Transformer Aggregation Network for Deep Face Image Super-Resolution
    Bao, Qiqi
    Liu, Yunmeng
    Gang, Bowen
    Yang, Wenming
    Liao, Qingmin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 8554 - 8565
  • [26] Densely Connected Transformer With Linear Self-Attention for Lightweight Image Super-Resolution
    Zeng, Kun
    Lin, Hanjiang
    Yan, Zhiqiang
    Fang, Jinsheng
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [27] INFORMATION-GROWTH SWIN TRANSFORMER NETWORK FOR IMAGE SUPER-RESOLUTION
    Ji, Yantao
    Jiang, Peilin
    Shi, Jingang
    Guo, Yu
    Zhang, Ruiteng
    Wang, Fei
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 3993 - 3997
  • [28] CNN–Transformer gated fusion network for medical image super-resolution
    Juanjuan Qin
    Jian Xiong
    Zhantu Liang
    Scientific Reports, 15 (1)
  • [29] Dual Learning-Based Graph Neural Network for Remote Sensing Image Super-Resolution
    Liu, Ziyu
    Feng, Ruyi
    Wang, Lizhe
    Han, Wei
    Zeng, Tieyong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [30] An Iris Image Super-Resolution Model Based on Swin Transformer and Generative Adversarial Network
    Lu, Hexin
    Zhu, Xiaodong
    Cui, Jingwei
    Jiang, Haifeng
    ALGORITHMS, 2024, 17 (03)