Disentangled feature fusion network for lightweight image super-resolution

被引:2
|
作者
Liu, Huilin [1 ]
Zhou, Jianyu [1 ]
Su, Shuzhi [1 ]
Yang, Gaoming [1 ]
Zhang, Pengfei [1 ]
机构
[1] Anhui Univ Sci & Technol, Sch Comp Sci & Engn, Huainan 232001, Peoples R China
基金
中国国家自然科学基金;
关键词
Image super-resolution; Disentanglement; Network width; Feature fusion; Lightweight;
D O I
10.1016/j.dsp.2024.104697
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recently, the quality of generated images in image super-resolution (SR) has significantly improved due to the widespread application of convolutional neural networks. Existing super-resolution methods often overlook the importance of network width and instead prioritize designing deeper network structures to improve performance. Deeper networks, however, demand greater computational resources and are more challenging to train, making them less suitable for devices with limited performance. To address this issue, we propose a novel method called the disentangled feature fusion network (DFFN). Specifically, we construct dual feature extraction streams (DFES) using the strategies of feature disentanglement and parameter sharing, which increase the network's width without increasing the number of parameters. To facilitate the interaction of information between the dual feature extraction streams, we design a feature interaction module (FIM) that separately enhances high and low- frequency features. Furthermore, a feature fusion module (FFM) is presented to efficiently fuse different levels of high and low-frequency feature information. The proposed DFFN integrates DFES, FIM, and FFM, which not only widens the network without increasing parameters but also minimizes the loss of crucial feature information. Extensive experiments on five benchmark datasets demonstrate that our method significantly outperforms other state-of-the-art lightweight super-resolution methods, achieving a superior balance between parameter quantity, reconstruction performance, and model complexity. The code is available at https://github.com/zhoujyaust/DFFN.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Lightweight image super-resolution network using involution
    Liang, Jiu
    Zhang, Yu
    Xue, Jiangbo
    Hu, Yanda
    MACHINE VISION AND APPLICATIONS, 2022, 33 (05)
  • [22] A scalable attention network for lightweight image super-resolution
    Fang, Jinsheng
    Chen, Xinyu
    Zhao, Jianglong
    Zeng, Kun
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2024, 36 (08)
  • [23] An efficient lightweight network for single image super-resolution*
    Tang, Yinggan
    Zhang, Xiang
    Zhang, Xuguang
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 93
  • [24] Image Super-Resolution via Lightweight Attention-Directed Feature Aggregation Network
    Wang, Li
    Li, Ke
    Tang, Jingjing
    Liang, Yuying
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (02)
  • [25] Balanced Spatial Feature Distillation and Pyramid Attention Network for Lightweight Image Super-resolution
    Gendy, Garas
    Sabor, Nabil
    Hou, Jingchao
    He, Guanghui
    NEUROCOMPUTING, 2022, 509 (157-166) : 157 - 166
  • [26] Lightweight Parallel Feedback Network for Image Super-Resolution
    Wang, Beibei
    Liu, Changjun
    Yan, Binyu
    Yang, Xiaomin
    NEURAL PROCESSING LETTERS, 2023, 55 (03) : 3225 - 3243
  • [27] Lightweight single image super-resolution based on multi-path progressive feature fusion and attention mechanism
    Shanshan Li
    Dengwen Zhou
    Yukai Liu
    Dandan Gao
    Wanjun Wang
    International Journal of Machine Learning and Cybernetics, 2023, 14 : 3517 - 3528
  • [28] Lightweight single image super-resolution based on multi-path progressive feature fusion and attention mechanism
    Li, Shanshan
    Zhou, Dengwen
    Liu, Yukai
    Gao, Dandan
    Wang, Wanjun
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (10) : 3517 - 3528
  • [29] Multi-scale receptive field fusion network for lightweight image super-resolution
    Luo, Jing
    Zhao, Lin
    Zhu, Li
    Tao, Wenbing
    NEUROCOMPUTING, 2022, 493 : 314 - 326
  • [30] Efficient Adaptive Feature Fusion Network for Remote-Sensing Image Super-Resolution
    Hao, Shuai
    Liu, Shuai
    Jia, Xu
    Lu, Huchuan
    He, You
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 3089 - 3093