A multi-scale feature cross-dimensional interaction network for stereo image super-resolution

被引:0
作者
Zhang, Jingcheng [1 ]
Zhu, Yu [1 ]
Peng, Shengjun [3 ]
Niu, Axi [1 ]
Yan, Qingsen [1 ]
Sun, Jinqiu [2 ]
Zhang, Yanning [1 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Peoples R China
[2] Northwestern Polytech Univ, Sch Astronaut, Xian 710072, Peoples R China
[3] China Xian Satellite Control Ctr, Xian 710699, Peoples R China
基金
中国国家自然科学基金;
关键词
Stereo image super-resolution; Multi-scale; Feature fusion; Cross-dimensional attention;
D O I
10.1007/s00530-025-01714-8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, stereo image super-resolution (SSR) has achieved impressive performance by leveraging both intra-view and inter-view information. However, existing SSR methods often rely on single-scale features for stereo image feature extraction and overlook multi-dimensional feature interactions, resulting in poor visual quality with unclear and insufficiently sharp reconstruction of details. To address these issues and achieve better performance for stereo image super-resolution, we propose a multi-scale feature cross-dimensional interaction network (MFCINet) for SSR. Specifically, to fully exploit intra-view information, we design multi-scale feature extraction blocks to capture abundant multi-scale texture patterns, including the Local Feature Extraction Block (LFEB), Mesoscale Feature Extraction Block (MFEB), and Global Feature Extraction Block (GFEB). We progressively fuse smaller-scale features with larger-scale features, utilizing the local texture information contained in the smaller-scale features to refine the global structure information of the larger-scale features. To explore richer interactions of complementary features, we introduce the Cross-dimensional Attention Interaction Block (CAIB), which calculates attention between complementary features across different spatial positions and channels, facilitating comprehensive interaction among complementary features across various dimensions. Extensive experiments and ablation studies demonstrate that MFCINet better leverages intra-view and inter-view information to reconstruct clear texture details, achieving competitive results and outperforming state-of-the-art methods.
引用
收藏
页数:15
相关论文
共 50 条
[41]   Separable feature complementary network with branch-wise and multi-scale spatial attention for lightweight image super-resolution [J].
Wenming Zhang ;
Qiming Han ;
Yaqian Li ;
Haibin Li .
Signal, Image and Video Processing, 2024, 18 :1715-1724
[42]   Lightweight Image Super-Resolution Based on Local Interaction of Multi-Scale Features and Global Fusion [J].
Meng, Zhiqing ;
Zhang, Jing ;
Li, Xiangjun ;
Zhang, Lingyin .
MATHEMATICS, 2022, 10 (07)
[43]   A novel image super-resolution algorithm based on multi-scale dense recursive fusion network [J].
Lv, Xiang ;
Wang, Changzhong ;
Fan, Xiaodong ;
Leng, Qiangkui ;
Jiang, Xiaoli .
NEUROCOMPUTING, 2022, 489 :98-111
[44]   Efficient Multi-Scale Cosine Attention Transformer for Image Super-Resolution [J].
Chen, Yuzhen ;
Wang, Gencheng ;
Chen, Rong .
IEEE SIGNAL PROCESSING LETTERS, 2023, 30 :1442-1446
[45]   Coarse-to-Fine Cross-View Interaction Based Accurate Stereo Image Super-Resolution Network [J].
Liu, Anqi ;
Li, Sumei ;
Chang, Yongli ;
Zhang, Wenlin ;
Hou, Yonghong .
IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 :7321-7334
[46]   A multi-scale enhanced large-kernel attention transformer network for lightweight image super-resolution [J].
Chang, Kairong ;
Jun, Sun ;
Biao, Yang ;
Hu, Mingzhi ;
Yang, Junlong .
SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (03)
[47]   Image Super-Resolution Reconstruction Based on Recursive Multi-scale Convolutional Networks [J].
Gao Q. ;
Zhao J. ;
Zhou Z. .
Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2020, 33 (11) :972-980
[48]   MRANet: Multi-atrous residual attention Network for stereo image super-resolution [J].
Ning, Luyao ;
Wang, Anhong ;
Zhao, Lijun ;
Xue, Weimin ;
Bu, Donghan .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 77
[49]   Multi-feature fusion attention network for single image super-resolution [J].
Chen, Jiacheng ;
Wang, Wanliang ;
Xing, Fangsen ;
Tu, Hangyao .
IET IMAGE PROCESSING, 2023, 17 (05) :1389-1402
[50]   Jointly Texture Enhanced and Stereo Captured Network for Stereo Image Super-Resolution [J].
Jin, Kangjun ;
Wang, Xuejin ;
Shao, Feng .
PATTERN RECOGNITION LETTERS, 2023, 167 :141-148