A multi-scale feature cross-dimensional interaction network for stereo image super-resolution

被引:0
作者
Zhang, Jingcheng [1 ]
Zhu, Yu [1 ]
Peng, Shengjun [3 ]
Niu, Axi [1 ]
Yan, Qingsen [1 ]
Sun, Jinqiu [2 ]
Zhang, Yanning [1 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Peoples R China
[2] Northwestern Polytech Univ, Sch Astronaut, Xian 710072, Peoples R China
[3] China Xian Satellite Control Ctr, Xian 710699, Peoples R China
基金
中国国家自然科学基金;
关键词
Stereo image super-resolution; Multi-scale; Feature fusion; Cross-dimensional attention;
D O I
10.1007/s00530-025-01714-8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, stereo image super-resolution (SSR) has achieved impressive performance by leveraging both intra-view and inter-view information. However, existing SSR methods often rely on single-scale features for stereo image feature extraction and overlook multi-dimensional feature interactions, resulting in poor visual quality with unclear and insufficiently sharp reconstruction of details. To address these issues and achieve better performance for stereo image super-resolution, we propose a multi-scale feature cross-dimensional interaction network (MFCINet) for SSR. Specifically, to fully exploit intra-view information, we design multi-scale feature extraction blocks to capture abundant multi-scale texture patterns, including the Local Feature Extraction Block (LFEB), Mesoscale Feature Extraction Block (MFEB), and Global Feature Extraction Block (GFEB). We progressively fuse smaller-scale features with larger-scale features, utilizing the local texture information contained in the smaller-scale features to refine the global structure information of the larger-scale features. To explore richer interactions of complementary features, we introduce the Cross-dimensional Attention Interaction Block (CAIB), which calculates attention between complementary features across different spatial positions and channels, facilitating comprehensive interaction among complementary features across various dimensions. Extensive experiments and ablation studies demonstrate that MFCINet better leverages intra-view and inter-view information to reconstruct clear texture details, achieving competitive results and outperforming state-of-the-art methods.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Single image super-resolution based on multi-scale dense attention network
    Farong Gao
    Yong Wang
    Zhangyi Yang
    Yuliang Ma
    Qizhong Zhang
    Soft Computing, 2023, 27 : 2981 - 2992
  • [22] Single Image Super-Resolution Using Multi-scale Convolutional Neural Network
    Jia, Xiaoyi
    Xu, Xiangmin
    Cai, Bolun
    Guo, Kailing
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2017, PT I, 2018, 10735 : 149 - 157
  • [23] Quaternion attention multi-scale widening network for endoscopy image super-resolution
    Lin, Junyu
    Huang, Guoheng
    Huang, Jun
    Yuan, Xiaochen
    Zeng, Yiwen
    Shi, Cheng
    PHYSICS IN MEDICINE AND BIOLOGY, 2023, 68 (07)
  • [24] Single-image super-resolution via selective multi-scale network
    Zewei He
    Binjie Ding
    Guizhong Fu
    Yanpeng Cao
    Jiangxin Yang
    Yanlong Cao
    Signal, Image and Video Processing, 2022, 16 : 937 - 945
  • [25] Lightweight Image Super-Resolution via Weighted Multi-Scale Residual Network
    Sun, Long
    Liu, Zhenbing
    Sun, Xiyan
    Liu, Licheng
    Lan, Rushi
    Luo, Xiaonan
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2021, 8 (07) : 1271 - 1280
  • [26] Single-image super-resolution via selective multi-scale network
    He, Zewei
    Ding, Binjie
    Fu, Guizhong
    Cao, Yanpeng
    Yang, Jiangxin
    Cao, Yanlong
    SIGNAL IMAGE AND VIDEO PROCESSING, 2022, 16 (04) : 937 - 945
  • [27] Single image super-resolution based on multi-scale dense attention network
    Gao, Farong
    Wang, Yong
    Yang, Zhangyi
    Ma, Yuliang
    Zhang, Qizhong
    SOFT COMPUTING, 2023, 27 (06) : 2981 - 2992
  • [28] Multi-Scale Residual Fusion Network for Super-Resolution Reconstruction of Single Image
    Zhao, Baiting
    Hu, Rui
    Jia, Xiaofen
    Guo, Yongcun
    IEEE ACCESS, 2020, 8 : 155285 - 155295
  • [29] Multi-Scale Feature Fusion and Structure-Preserving Network for Face Super-Resolution
    Yang, Dingkang
    Wei, Yehua
    Hu, Chunwei
    Yu, Xin
    Sun, Cheng
    Wu, Sheng
    Zhang, Jin
    APPLIED SCIENCES-BASEL, 2023, 13 (15):
  • [30] MFEN: Lightweight multi-scale feature extraction super-resolution network in embedded system
    Xiao, Hang
    Qin, Jiayi
    Jeon, Seunggil
    Yan, Binyu
    Yang, Xiaomin
    MICROPROCESSORS AND MICROSYSTEMS, 2022, 93