Lightweight interactive feature inference network for single-image super-resolution

被引:6
作者
Wang, Li [1 ]
Li, Xing [2 ]
Tian, Wei [3 ]
Peng, Jianhua [1 ]
Chen, Rui [1 ]
机构
[1] Nanjing Vocat Univ Ind Technol, Sch Comp & Software, Nanjing 210023, Peoples R China
[2] Nanjing Forestry Univ, Coll Informat Sci & Technol, Coll Artificial Intelligence, Nanjing 210037, Peoples R China
[3] Guizhou Univ Commerce, Coll Comp & Informat Engn, Guiyang 550014, Peoples R China
关键词
Super-resolution; Convolution neural network; Transformer; Local and global priors; ACCURATE;
D O I
10.1038/s41598-024-62633-8
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The emergence of convolutional neural network (CNN) and transformer has recently facilitated significant advances in image super-resolution (SR) tasks. However, these networks commonly construct complex structures, having huge model parameters and high computational costs, to boost reconstruction performance. In addition, they do not consider the structural prior well, which is not conducive to high-quality image reconstruction. In this work, we devise a lightweight interactive feature inference network (IFIN), complementing the strengths of CNN and Transformer, for effective image SR reconstruction. Specifically, the interactive feature aggregation module (IFAM), implemented by structure-aware attention block (SAAB), Swin Transformer block (SWTB), and enhanced spatial adaptive block (ESAB), serves as the network backbone, progressively extracts more dedicated features to facilitate the reconstruction of high-frequency details in the image. SAAB adaptively recalibrates local salient structural information, and SWTB effectively captures rich global information. Further, ESAB synergetically complements local and global priors to ensure the consistent fusion of diverse features, achieving high-quality reconstruction of images. Comprehensive experiments reveal that our proposed networks attain state-of-the-art reconstruction accuracy on benchmark datasets while maintaining low computational demands. Our code and results are available at: https://github.com/wwaannggllii/IFIN.
引用
收藏
页数:20
相关论文
共 66 条
[1]   Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Network [J].
Ahn, Namhyuk ;
Kang, Byungkon ;
Sohn, Kyung-Ah .
COMPUTER VISION - ECCV 2018, PT X, 2018, 11214 :256-272
[2]  
Banerjee S, 2020, Arxiv, DOI [arXiv:2008.01116, 10.48550/arXiv.2008.01116]
[3]   Single Image Super-Resolution via a Holistic Attention Network [J].
Niu, Ben ;
Wen, Weilei ;
Ren, Wenqi ;
Zhang, Xiangde ;
Yang, Lianping ;
Wang, Shuzhen ;
Zhang, Kaihao ;
Cao, Xiaochun ;
Shen, Haifeng .
COMPUTER VISION - ECCV 2020, PT XII, 2020, 12357 :191-207
[4]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[5]   HIPA: Hierarchical Patch Transformer for Single Image Super Resolution [J].
Cai, Qing ;
Qian, Yiming ;
Li, Jinxing ;
Lyu, Jun ;
Yang, Yee-Hong ;
Wu, Feng ;
Zhang, David .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 :3226-3237
[6]   Pre-Trained Image Processing Transformer [J].
Chen, Hanting ;
Wang, Yunhe ;
Guo, Tianyu ;
Xu, Chang ;
Deng, Yiping ;
Liu, Zhenhua ;
Ma, Siwei ;
Xu, Chunjing ;
Xu, Chao ;
Gao, Wen .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :12294-12305
[7]   N-Gram in Swin Transformers for Efficient Lightweight Image Super-Resolution [J].
Choi, Haram ;
Lee, Jeongmin ;
Yang, Jihoon .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, :2071-2081
[8]   Fast, Accurate and Lightweight Super-Resolution with Neural Architecture Search [J].
Chu, Xiangxiang ;
Zhang, Bo ;
Ma, Hailong ;
Xu, Ruijun ;
Li, Qingyuan .
2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, :59-64
[9]   CFGN: A Lightweight Context Feature Guided Network for Image Super-Resolution [J].
Dai, Tao ;
Ya, Mengxi ;
Li, Jinmin ;
Zhang, Xinyi ;
Xia, Shu-Tao ;
Zhu, Zexuan .
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (01) :855-865
[10]   Accelerating the Super-Resolution Convolutional Neural Network [J].
Dong, Chao ;
Loy, Chen Change ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :391-407