An efficient feature reuse distillation network for lightweight image super-resolution

被引:1
作者
Liu, Chunying [1 ,2 ,3 ]
Gao, Guangwei [1 ,2 ,3 ]
Wu, Fei [1 ]
Guo, Zhenhua [4 ]
Yu, Yi [5 ]
机构
[1] Nanjing Univ Posts & Telecommun, Inst Adv Technol, Nanjing, Peoples R China
[2] Minist Educ, Key Lab Artificial Intelligence, Shanghai, Peoples R China
[3] Soochow Univ, Prov Key Lab Comp Informat Proc Technol, Suzhou, Peoples R China
[4] Tianyijiaotong Technol Ltd, Suzhou, Peoples R China
[5] Hiroshima Univ, Grad Sch Adv Sci & Engn, Hiroshima, Japan
基金
中国国家自然科学基金;
关键词
Single-image super-resolution; Lightweight network; Feature reuse; Transformer;
D O I
10.1016/j.cviu.2024.104178
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent research, single-image super-resolution (SISR) using deep Convolutional Neural Networks (CNN) has seen significant advancements. While previous methods excelled at learning complex mappings between low-resolution (LR) and high-resolution (HR) images, they often required substantial computational and memory resources. We propose the Efficient Feature Reuse Distillation Network (EFRDN) to alleviate these challenges. EFRDN primarily comprises Asymmetric Convolutional Distillation Modules (ACDM), incorporating the Multiple Self-Calibrating Convolution (MSCC) units for spatial and channel feature extraction. It includes an Asymmetric Convolution Residual Block (ACRB) to enhance the skeleton information of the square convolution kernel and a Feature Fusion Lattice Block (FFLB) to convert low-order input signals into higher-order representations. Introducing a Transformer module for global features, we enhance feature reuse and gradient flow, improving model performance and efficiency. Extensive experimental results demonstrate that EFRDN outperforms existing methods in performance while conserving computing and memory resources.
引用
收藏
页数:10
相关论文
共 52 条
[1]   Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Network [J].
Ahn, Namhyuk ;
Kang, Byungkon ;
Sohn, Kyung-Ah .
COMPUTER VISION - ECCV 2018, PT X, 2018, 11214 :256-272
[2]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[3]   Fast, Accurate and Lightweight Super-Resolution with Neural Architecture Search [J].
Chu, Xiangxiang ;
Zhang, Bo ;
Ma, Hailong ;
Xu, Ruijun ;
Li, Qingyuan .
2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, :59-64
[4]   DaViT: Dual Attention Vision Transformers [J].
Ding, Mingyu ;
Xiao, Bin ;
Codella, Noel ;
Luo, Ping ;
Wang, Jingdong ;
Yuan, Lu .
COMPUTER VISION, ECCV 2022, PT XXIV, 2022, 13684 :74-92
[5]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[6]   CTCNet: A CNN-Transformer Cooperation Network for Face Image Super-Resolution [J].
Gao, Guangwei ;
Xu, Zixiang ;
Li, Juncheng ;
Yang, Jian ;
Zeng, Tieyong ;
Qi, Guo-Jun .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 :1978-1991
[7]  
Gao GW, 2022, AAAI CONF ARTIF INTE, P661
[8]   Multimodal Multi-Head Convolutional Attention with Various Kernel Sizes for Medical Image Super-Resolution [J].
Georgescu, Mariana-Iuliana ;
Ionescu, Radu Tudor ;
Miron, Andreea-Iuliana ;
Savencu, Olivian ;
Ristea, Nicolae-Catalin ;
Verga, Nicolae ;
Khan, Fahad Shahbaz .
2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, :2194-2204
[9]  
Huang JB, 2015, PROC CVPR IEEE, P5197, DOI 10.1109/CVPR.2015.7299156
[10]   Lightweight Image Super-Resolution with Information Multi-distillation Network [J].
Hui, Zheng ;
Gao, Xinbo ;
Yang, Yunchu ;
Wang, Xiumei .
PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, :2024-2032