Disentangled feature fusion network for lightweight image super-resolution

被引:2
|
作者
Liu, Huilin [1 ]
Zhou, Jianyu [1 ]
Su, Shuzhi [1 ]
Yang, Gaoming [1 ]
Zhang, Pengfei [1 ]
机构
[1] Anhui Univ Sci & Technol, Sch Comp Sci & Engn, Huainan 232001, Peoples R China
基金
中国国家自然科学基金;
关键词
Image super-resolution; Disentanglement; Network width; Feature fusion; Lightweight;
D O I
10.1016/j.dsp.2024.104697
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recently, the quality of generated images in image super-resolution (SR) has significantly improved due to the widespread application of convolutional neural networks. Existing super-resolution methods often overlook the importance of network width and instead prioritize designing deeper network structures to improve performance. Deeper networks, however, demand greater computational resources and are more challenging to train, making them less suitable for devices with limited performance. To address this issue, we propose a novel method called the disentangled feature fusion network (DFFN). Specifically, we construct dual feature extraction streams (DFES) using the strategies of feature disentanglement and parameter sharing, which increase the network's width without increasing the number of parameters. To facilitate the interaction of information between the dual feature extraction streams, we design a feature interaction module (FIM) that separately enhances high and low- frequency features. Furthermore, a feature fusion module (FFM) is presented to efficiently fuse different levels of high and low-frequency feature information. The proposed DFFN integrates DFES, FIM, and FFM, which not only widens the network without increasing parameters but also minimizes the loss of crucial feature information. Extensive experiments on five benchmark datasets demonstrate that our method significantly outperforms other state-of-the-art lightweight super-resolution methods, achieving a superior balance between parameter quantity, reconstruction performance, and model complexity. The code is available at https://github.com/zhoujyaust/DFFN.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] PFFN: Progressive Feature Fusion Network for Lightweight Image Super-Resolution
    Zhang, Dongyang
    Li, Changyu
    Xie, Ning
    Wang, Guoqing
    Shao, Jie
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 3682 - 3690
  • [2] Lightweight Single Image Super-Resolution With Similar Feature Fusion Block
    Wang, Zirui
    Liu, Yunmeng
    Zhu, Rui
    Yang, Wenming
    Liao, Qingmin
    IEEE ACCESS, 2022, 10 : 30974 - 30981
  • [3] An efficient and lightweight image super-resolution with feature network
    Zang, Yongsheng
    Zhou, Dongming
    Wang, Changcheng
    Nie, Rencan
    Guo, Yanbu
    OPTIK, 2022, 255
  • [4] A very lightweight and efficient image super-resolution network?
    Gao, Dandan
    Zhou, Dengwen
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 213
  • [5] Feature Fusion Attention Network for Image Super-resolution
    Zhou D.-W.
    Ma L.-Y.
    Tian J.-Y.
    Sun X.-X.
    Zidonghua Xuebao/Acta Automatica Sinica, 2022, 48 (09): : 2233 - 2241
  • [6] CFGN: A Lightweight Context Feature Guided Network for Image Super-Resolution
    Dai, Tao
    Ya, Mengxi
    Li, Jinmin
    Zhang, Xinyi
    Xia, Shu-Tao
    Zhu, Zexuan
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (01): : 855 - 865
  • [7] GRFN: A Group Residual Feature Network for Lightweight Image Super-Resolution
    Yang, Xin
    Hong, Chaming
    Zhang, Panpan
    CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2025, : 3513 - 3533
  • [8] A sparse lightweight attention network for image super-resolution
    Hongao Zhang
    Jinsheng Fang
    Siyu Hu
    Kun Zeng
    The Visual Computer, 2024, 40 (2) : 1261 - 1272
  • [9] A sparse lightweight attention network for image super-resolution
    Zhang, Hongao
    Fang, Jinsheng
    Hu, Siyu
    Zeng, Kun
    VISUAL COMPUTER, 2024, 40 (02) : 1261 - 1272
  • [10] Multiscale Feature Fusion Back-projection Network for Image Super-resolution
    Sun C.-W.
    Chen X.
    Zidonghua Xuebao/Acta Automatica Sinica, 2021, 47 (07): : 1689 - 1700