CVGSR: Stereo image Super-Resolution with Cross-View guidance *

被引:3
|
作者
Chen, Wenfei [1 ]
Ni, Shijia [2 ]
Shao, Feng [2 ]
机构
[1] Ningbo Inst Intelligent Equipment Technol Co Ltd, Ningbo 315200, Peoples R China
[2] Ningbo Univ, Fac Informat Sci & Engn, Ningbo 315211, Zhejiang, Peoples R China
关键词
Stereo image super-resolution; Cross-view interaction; Transformer; PARALLAX ATTENTION; NETWORK; MODULE;
D O I
10.1016/j.displa.2024.102736
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The ability to capture the complementary information of stereo images is critical to the development of stereo image super -resolution. Most existing studies have attempted to integrate reliable stereo correspondence along the polar directions through parallax attention and various fusion strategies. However, most of these approaches ignore the large parallax differences in stereo images, resulting in poor performance of convolutional -based parallax attention in capturing the long-range dependencies between images. In this paper, we propose a novel cross -view guided stereo image super -resolution network (CVGSR) for reconstructing high -resolution stereo image pairs with rich texture details by fully exploiting the complementary nature of stereo image pairs. Specifically, we first deploy a cross -view interaction module (CVIM) to explore intra/cross-view dependencies from local to global to compensate for the incomplete compatibility of information between the left and right views. This module uses a progressive cross -guiding strategy to better merge features from occluded and non -occluded regions. Based on this, an efficient attention Transformer (EAT) is improved to activate more input information and further mine the cross -view complementarity. Furthermore, we design a texture loss to optimize the visual perceptual quality of reconstructed images with sharp boundaries and rich texture details. Extensive experiments on four stereo image datasets demonstrate that the proposed CVGSR achieves a competitive and excellent performance.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Feedback Network for Mutually Boosted Stereo Image Super-Resolution and Disparity Estimation
    Dai, Qinyan
    Li, Juncheng
    Yi, Qiaosi
    Fang, Faming
    Zhang, Guixu
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 1985 - 1993
  • [22] Learning Epipolar Line Window Attention for Stereo Image Super-Resolution Reconstruction
    Li, Xue
    Zhang, Hongying
    Ye, Zixun
    Huang, Xiaoru
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 78 (02): : 2847 - 2864
  • [23] Efficient masked feature and group attention network for stereo image super-resolution
    Song, Jianwen
    Sowmya, Arcot
    Kato, Jien
    Sun, Changming
    IMAGE AND VISION COMPUTING, 2024, 151
  • [24] Light Field Image Super-Resolution With Transformers
    Liang, Zhengyu
    Wang, Yingqian
    Wang, Longguang
    Yang, Jungang
    Zhou, Shilin
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 563 - 567
  • [25] MRANet: Multi-atrous residual attention Network for stereo image super-resolution
    Ning, Luyao
    Wang, Anhong
    Zhao, Lijun
    Xue, Weimin
    Bu, Donghan
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 77
  • [26] Stereo Image Super-Resolution Based on Pixel-Wise Knowledge Distillation Strategy
    Ma, Li
    Li, Sumei
    2021 INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2021,
  • [27] Remote sensing image super-resolution via cross-scale hierarchical transformer
    Xiao, Yi
    Yuan, Qiangqiang
    He, Jiang
    Zhang, Liangpei
    GEO-SPATIAL INFORMATION SCIENCE, 2024, 27 (06) : 1914 - 1930
  • [28] NON-LOCAL NESTED RESIDUAL ATTENTION NETWORK FOR STEREO IMAGE SUPER-RESOLUTION
    Xie, Wangduo
    Zhang, Jian
    Lu, Zhisheng
    Cao, Meng
    Zhao, Yong
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 2643 - 2647
  • [29] Towards real world stereo image super-resolution via hybrid degradation model and discriminator for implied stereo image information
    Zhou, Yuanbo
    Xue, Yuyang
    Bi, Jiang
    He, Wenlin
    Zhang, Xinlin
    Zhang, Jiajun
    Deng, Wei
    Nie, Ruofeng
    Lan, Junlin
    Gao, Qinquan
    Tong, Tong
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 255
  • [30] Cross Transformer Network for Scale-Arbitrary Image Super-Resolution
    He, Dehong
    Wu, Song
    Liu, Jinpeng
    Xiao, Guoqiang
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT II, 2022, 13369 : 633 - 644