A multi-scale feature cross-dimensional interaction network for stereo image super-resolution

被引:0
|
作者
Zhang, Jingcheng [1 ]
Zhu, Yu [1 ]
Peng, Shengjun [3 ]
Niu, Axi [1 ]
Yan, Qingsen [1 ]
Sun, Jinqiu [2 ]
Zhang, Yanning [1 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Peoples R China
[2] Northwestern Polytech Univ, Sch Astronaut, Xian 710072, Peoples R China
[3] China Xian Satellite Control Ctr, Xian 710699, Peoples R China
基金
中国国家自然科学基金;
关键词
Stereo image super-resolution; Multi-scale; Feature fusion; Cross-dimensional attention;
D O I
10.1007/s00530-025-01714-8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, stereo image super-resolution (SSR) has achieved impressive performance by leveraging both intra-view and inter-view information. However, existing SSR methods often rely on single-scale features for stereo image feature extraction and overlook multi-dimensional feature interactions, resulting in poor visual quality with unclear and insufficiently sharp reconstruction of details. To address these issues and achieve better performance for stereo image super-resolution, we propose a multi-scale feature cross-dimensional interaction network (MFCINet) for SSR. Specifically, to fully exploit intra-view information, we design multi-scale feature extraction blocks to capture abundant multi-scale texture patterns, including the Local Feature Extraction Block (LFEB), Mesoscale Feature Extraction Block (MFEB), and Global Feature Extraction Block (GFEB). We progressively fuse smaller-scale features with larger-scale features, utilizing the local texture information contained in the smaller-scale features to refine the global structure information of the larger-scale features. To explore richer interactions of complementary features, we introduce the Cross-dimensional Attention Interaction Block (CAIB), which calculates attention between complementary features across different spatial positions and channels, facilitating comprehensive interaction among complementary features across various dimensions. Extensive experiments and ablation studies demonstrate that MFCINet better leverages intra-view and inter-view information to reconstruct clear texture details, achieving competitive results and outperforming state-of-the-art methods.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Multi-Scale Visual Perception Based Progressive Feature Interaction Network for Stereo Image Super-Resolution
    Liu, Anqi
    Li, Sumei
    Chang, Yongli
    Hou, Yonghong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (03) : 1615 - 1626
  • [2] Multi-scale feature aggregation network for Image super-resolution
    Chen, Wenlong
    Yao, Pengcheng
    Gai, Shaoyan
    Da, Feipeng
    APPLIED INTELLIGENCE, 2022, 52 (04) : 3577 - 3586
  • [3] Multi-scale feature aggregation network for Image super-resolution
    Wenlong Chen
    Pengcheng Yao
    Shaoyan Gai
    Feipeng Da
    Applied Intelligence, 2022, 52 : 3577 - 3586
  • [4] MDCN: Multi-Scale Dense Cross Network for Image Super-Resolution
    Li, Juncheng
    Fang, Faming
    Li, Jiaqian
    Mei, Kangfu
    Zhang, Guixu
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (07) : 2547 - 2561
  • [5] Gradient-Guided and Multi-Scale Feature Network for Image Super-Resolution
    Chen, Jian
    Huang, Detian
    Zhu, Xiancheng
    Chen, Feiyang
    APPLIED SCIENCES-BASEL, 2022, 12 (06):
  • [6] Efficient Hybrid Feature Interaction Network for Stereo Image Super-Resolution
    Song, Jianwen
    Sowmya, Arcot
    Sun, Changming
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 10094 - 10105
  • [7] Multi-scale attention network for image super-resolution
    Wang, Li
    Shen, Jie
    Tang, E.
    Zheng, Shengnan
    Xu, Lizhong
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 80
  • [8] Multi-scale generative adversarial network for image super-resolution
    Jiang Daihong
    Zhang Sai
    Dai Lei
    Dai Yueming
    Soft Computing, 2022, 26 : 3631 - 3641
  • [9] Multi-scale generative adversarial network for image super-resolution
    Daihong, Jiang
    Sai, Zhang
    Lei, Dai
    Yueming, Dai
    SOFT COMPUTING, 2022, 26 (08) : 3631 - 3641
  • [10] Image Super-Resolution Based on Multi-scale Fusion Network
    Lin, Leping
    Huang, Huiling
    Ouyang, Ning
    COMMUNICATIONS, SIGNAL PROCESSING, AND SYSTEMS, CSPS 2018, VOL II: SIGNAL PROCESSING, 2020, 516 : 67 - 73