CSINet: A Cross-Scale Interaction Network for Lightweight Image Super-Resolution

被引:3
|
作者
Ke, Gang [1 ,2 ]
Lo, Sio-Long [1 ]
Zou, Hua [3 ]
Liu, Yi-Feng [1 ]
Chen, Zhen-Qiang [1 ]
Wang, Jing-Kai [1 ]
机构
[1] Macau Univ Sci & Technol, Sch Comp Sci & Engn, Macau 999078, Peoples R China
[2] Dongguan Polytech, Sch Elect Informat, Dongguan 523109, Peoples R China
[3] Wuhan Univ, Sch Comp Sci, Wuhan 430072, Peoples R China
关键词
super-resolution; cross-scale interaction; factorized convolution; efficient large convolutional kernel attention;
D O I
10.3390/s24041135
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In recent years, advancements in deep Convolutional Neural Networks (CNNs) have brought about a paradigm shift in the realm of image super-resolution (SR). While augmenting the depth and breadth of CNNs can indeed enhance network performance, it often comes at the expense of heightened computational demands and greater memory usage, which can restrict practical deployment. To mitigate this challenge, we have incorporated a technique called factorized convolution and introduced the efficient Cross-Scale Interaction Block (CSIB). CSIB employs a dual-branch structure, with one branch extracting local features and the other capturing global features. Interaction operations take place in the middle of this dual-branch structure, facilitating the integration of cross-scale contextual information. To further refine the aggregated contextual information, we designed an Efficient Large Kernel Attention (ELKA) using large convolutional kernels and a gating mechanism. By stacking CSIBs, we have created a lightweight cross-scale interaction network for image super-resolution named "CSINet". This innovative approach significantly reduces computational costs while maintaining performance, providing an efficient solution for practical applications. The experimental results convincingly demonstrate that our CSINet surpasses the majority of the state-of-the-art lightweight super-resolution techniques used on widely recognized benchmark datasets. Moreover, our smaller model, CSINet-S, shows an excellent performance record on lightweight super-resolution benchmarks with extremely low parameters and Multi-Adds (e.g., 33.82 dB@Set14 x 2 with only 248 K parameters).
引用
收藏
页数:22
相关论文
共 50 条
  • [31] Lightweight subpixel sampling network for image super-resolution
    Zeng, Hongfei
    Wu, Qiang
    Zhang, Jin
    Xia, Haojie
    VISUAL COMPUTER, 2024, 40 (05): : 3781 - 3793
  • [32] Lightweight bidirectional feedback network for image super-resolution
    Wang, Beibei
    Yan, Binyu
    Liu, Changjun
    Hwangbo, Ryul
    Jeon, Gwanggil
    Yang, Xiaomin
    COMPUTERS & ELECTRICAL ENGINEERING, 2022, 102
  • [33] Lightweight image super-resolution network using involution
    Jiu Liang
    Yu Zhang
    Jiangbo Xue
    Yu Zhang
    Yanda Hu
    Machine Vision and Applications, 2022, 33
  • [34] LIRSRN: A Lightweight Infrared Image Super-Resolution Network
    Lin, Chun-An
    Liu, Tsung-Jung
    Liu, Kuan-Hsien
    2024 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS 2024, 2024,
  • [35] A very lightweight and efficient image super-resolution network?
    Gao, Dandan
    Zhou, Dengwen
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 213
  • [36] Lightweight image super-resolution network using involution
    Liang, Jiu
    Zhang, Yu
    Xue, Jiangbo
    Hu, Yanda
    MACHINE VISION AND APPLICATIONS, 2022, 33 (05)
  • [37] Pansharpening via Super-Resolution Iterative Residual Network With a Cross-Scale Learning Strategy
    Chen, Shiyu
    Qi, Hua
    Nan, Ke
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [38] Lightweight Image Super-Resolution with ConvNeXt Residual Network
    Yong Zhang
    Haomou Bai
    Yaxing Bing
    Xiao Liang
    Neural Processing Letters, 2023, 55 : 9545 - 9561
  • [39] An efficient lightweight network for single image super-resolution*
    Tang, Yinggan
    Zhang, Xiang
    Zhang, Xuguang
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 93
  • [40] A sparse lightweight attention network for image super-resolution
    Hongao Zhang
    Jinsheng Fang
    Siyu Hu
    Kun Zeng
    The Visual Computer, 2024, 40 (2) : 1261 - 1272