Learning accurate and enriched features for stereo image super-resolution

被引:0
作者
Gao, Hu [1 ]
Dang, Depeng [1 ]
机构
[1] Beijing Normal Univ, Artificial Intelligence, Beijing 100000, Peoples R China
关键词
Stereo image super-resolution; Mixed-scale feature representation; Selective fusion attention module; Fast fourier convolution;
D O I
10.1016/j.patcog.2024.111170
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Stereo image super-resolution (stereoSR) aims to enhance the quality of super-resolution results by incorporating complementary information from an alternative view. Although current methods have shown significant advancements, they typically operate on representations at full resolution to preserve spatial details, facing challenges inaccurately capturing contextual information. Simultaneously, they utilize all feature similarities to cross-fuse information from the two views, potentially disregarding the impact of irrelevant information. To overcome this problem, we propose a mixed-scale selective fusion network (MSSFNet) to preserve precise spatial details and incorporate abundant contextual information, and adaptively select and fuse most accurate features from two views to enhance the promotion of high-quality stereoSR. Specifically, we develop a mixed scale block (MSB) that obtains contextually enriched feature representations across multiple spatial scales preserving precise spatial details. Furthermore, to dynamically retain the most essential cross-view information, we design a selective fusion attention module (SFAM) that searches and transfers the most accurate features from another view. To learn an enriched set of local and non-local features, we introduce a fast fourier convolution block (FFCB) to explicitly integrate frequency domain knowledge. Extensive experiments that MSSFNet achieves significant improvements over state-of-the-art approaches on both quantitative qualitative evaluations. The code and the pre-trained models will be released at https://github.com/Tombs98/ MSSFNet.
引用
收藏
页数:10
相关论文
共 47 条
  • [1] Joint Feature Aggregation for Stereo Image Super-resolution
    Ai, Zekun
    Luo, Xiaotong
    Qu, Yanyun
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 480 - 485
  • [2] Patch loss: A generic multi-scale perceptual loss for single image super-resolution
    An, Tai
    Mao, Binjie
    Xue, Bin
    Huo, Chunlei
    Xiang, Shiming
    Pan, Chunhong
    [J]. PATTERN RECOGNITION, 2023, 139
  • [3] Single image super-resolution based on directional variance attention network
    Behjati, Parichehr
    Rodriguez, Pau
    Fernandez, Carles
    Hupont, Isabelle
    Mehri, Armin
    Gonzalez, Jordi
    [J]. PATTERN RECOGNITION, 2023, 133
  • [4] Chen Ke, 2023, 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), P1764, DOI 10.1109/CVPRW59228.2023.00177
  • [5] Simple Baselines for Image Restoration
    Chen, Liangyu
    Chu, Xiaojie
    Zhang, Xiangyu
    Sun, Jian
    [J]. COMPUTER VISION, ECCV 2022, PT VII, 2022, 13667 : 17 - 33
  • [6] Single image super-resolution based on trainable feature matching attention network
    Chen, Qizhou
    Shao, Qing
    [J]. PATTERN RECOGNITION, 2024, 149
  • [7] Chi Lu, 2020, Advances in Neural Information Processing Systems, V33, P4479, DOI DOI 10.5555/3495724.3496100
  • [8] NAFSSR: Stereo Image Super-Resolution Using NAFNet
    Chu, Xiaojie
    Chen, Liangyu
    Yu, Wenqing
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 1238 - 1247
  • [9] Feedback Network for Mutually Boosted Stereo Image Super-Resolution and Disparity Estimation
    Dai, Qinyan
    Li, Juncheng
    Yi, Qiaosi
    Fang, Faming
    Zhang, Guixu
    [J]. PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 1985 - 1993
  • [10] Learning a Deep Convolutional Network for Image Super-Resolution
    Dong, Chao
    Loy, Chen Change
    He, Kaiming
    Tang, Xiaoou
    [J]. COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 : 184 - 199