A Dual Transformer Super-Resolution Network for Improving the Definition of Vibration Image

被引:4
|
作者
Zhu, Yang [1 ]
Wang, Sen [1 ]
Zhang, Yinhui [1 ]
He, Zifen [1 ]
Wang, Qingjian [1 ]
机构
[1] Kunming Univ Sci & Technol, Fac Mech & Elect Engn, Kunming 650500, Peoples R China
基金
中国国家自然科学基金;
关键词
Vibrations; Transformers; Superresolution; Feature extraction; Image reconstruction; Task analysis; Displacement measurement; Attention mechanism; computer vision; image super-resolution; transformer; visual vibration measurement;
D O I
10.1109/TIM.2022.3222503
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Visual measurement methods are gaining more and more attention in the field of structural body health monitoring due to the advantages of long-range, noncontact, and multipoint monitoring. However, the imaging system is usually affected by many factors, such as distortion, blurring, and noise, which lead to displacement measurement errors after the degradation of the acquired image quality. Therefore, in this article, we propose a structural body image super-resolution network based on a dual transformer architecture to improve the clarity of the collected structural body vibration displacement image to better capture the vibration displacement information of the target. Meanwhile, we design a dual transformer block based on an encoder-decoder architecture for the characteristics of vision-based structural body vibration displacement measurement tasks to better extract structural body image details and edge feature information. In this module, we introduce two different transformers. In addition, modules based on the encoder-decoder architecture focus more on the input and output image information and often ignore the feature information in different layers. Therefore, we introduce an attention mechanism in the network and interact with the feature information in different layers of the encoder-decoder architecture to obtain a better structural body image super-resolution effect. After comparison tests with the rest of the latest and most classical networks as well as the current optimal networks, it is shown that our network obtains excellent image reconstruction results under different structural body vibration image datasets (SETs), which also provides a strong guarantee for the task of accurate vision-based structural body vibration displacement measurement.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Steformer: Efficient Stereo Image Super-Resolution With Transformer
    Lin, Jianxin
    Yin, Lianying
    Wang, Yijun
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 8396 - 8407
  • [2] TCSR: Lightweight Transformer and CNN Interaction Network for Image Super-Resolution
    Cai, Danlin
    Tan, Wenwen
    Chen, Feiyang
    Lou, Xinchi
    Xiahou, Jianbin
    Zhu, Daxin
    Huang, Detian
    IEEE ACCESS, 2024, 12 : 174782 - 174795
  • [3] Edge-Aware Attention Transformer for Image Super-Resolution
    Wang, Haoqian
    Xing, Zhongyang
    Xu, Zhongjie
    Cheng, Xiangai
    Li, Teng
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 2905 - 2909
  • [4] Fusformer: A Transformer-Based Fusion Network for Hyperspectral Image Super-Resolution
    Hu, Jin-Fan
    Huang, Ting-Zhu
    Deng, Liang-Jian
    Dou, Hong-Xia
    Hong, Danfeng
    Vivone, Gemine
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [5] Efficient Dual Attention Transformer for Image Super-Resolution
    Park, Soobin
    Jeong, Yuna
    Choi, Yong Suk
    39TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING, SAC 2024, 2024, : 963 - 970
  • [6] Enhancing Image Super-Resolution with Dual Compression Transformer
    Yu, Jiaxing
    Chen, Zheng
    Wang, Jingkai
    Kong, Linghe
    Yan, Jiajie
    Gu, Wei
    VISUAL COMPUTER, 2025, 41 (07) : 4879 - 4892
  • [7] CTCNet: A CNN-Transformer Cooperation Network for Face Image Super-Resolution
    Gao, Guangwei
    Xu, Zixiang
    Li, Juncheng
    Yang, Jian
    Zeng, Tieyong
    Qi, Guo-Jun
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 1978 - 1991
  • [8] MESR: Multistage Enhancement Network for Image Super-Resolution
    Huang, Detian
    Chen, Jian
    IEEE ACCESS, 2022, 10 : 54599 - 54612
  • [9] SWCGAN: Generative Adversarial Network Combining Swin Transformer and CNN for Remote Sensing Image Super-Resolution
    Tu, Jingzhi
    Mei, Gang
    Ma, Zhengjing
    Piccialli, Francesco
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 5662 - 5673
  • [10] Cross Transformer Network for Scale-Arbitrary Image Super-Resolution
    He, Dehong
    Wu, Song
    Liu, Jinpeng
    Xiao, Guoqiang
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT II, 2022, 13369 : 633 - 644