Disentangled feature fusion network for lightweight image super-resolution

被引:1
|
作者
Liu, Huilin [1 ]
Zhou, Jianyu [1 ]
Su, Shuzhi [1 ]
Yang, Gaoming [1 ]
Zhang, Pengfei [1 ]
机构
[1] Anhui Univ Sci & Technol, Sch Comp Sci & Engn, Huainan 232001, Peoples R China
基金
中国国家自然科学基金;
关键词
Image super-resolution; Disentanglement; Network width; Feature fusion; Lightweight;
D O I
10.1016/j.dsp.2024.104697
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recently, the quality of generated images in image super-resolution (SR) has significantly improved due to the widespread application of convolutional neural networks. Existing super-resolution methods often overlook the importance of network width and instead prioritize designing deeper network structures to improve performance. Deeper networks, however, demand greater computational resources and are more challenging to train, making them less suitable for devices with limited performance. To address this issue, we propose a novel method called the disentangled feature fusion network (DFFN). Specifically, we construct dual feature extraction streams (DFES) using the strategies of feature disentanglement and parameter sharing, which increase the network's width without increasing the number of parameters. To facilitate the interaction of information between the dual feature extraction streams, we design a feature interaction module (FIM) that separately enhances high and low- frequency features. Furthermore, a feature fusion module (FFM) is presented to efficiently fuse different levels of high and low-frequency feature information. The proposed DFFN integrates DFES, FIM, and FFM, which not only widens the network without increasing parameters but also minimizes the loss of crucial feature information. Extensive experiments on five benchmark datasets demonstrate that our method significantly outperforms other state-of-the-art lightweight super-resolution methods, achieving a superior balance between parameter quantity, reconstruction performance, and model complexity. The code is available at https://github.com/zhoujyaust/DFFN.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Multi-scale feature selection network for lightweight image super-resolution
    Li, Minghong
    Zhao, Yuqian
    Zhang, Fan
    Luo, Biao
    Yang, Chunhua
    Gui, Weihua
    Chang, Kan
    NEURAL NETWORKS, 2024, 169 : 352 - 364
  • [32] Lightweight Feature Enhancement Network for Image Super-Resolution Reconstruction at Construction Sites
    Liu, Yicheng
    Ma, Xiang
    Cheng, Jing
    ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2024,
  • [33] PSMFNet: Lightweight Partial Separation and Multiscale Fusion Network for Image Super-Resolution
    Cao, Shuai
    Liang, Jianan
    Cao, Yongjun
    Huang, Jinglun
    Yang, Zhishu
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 81 (01):
  • [34] Fusion diversion network for fast, accurate and lightweight single image super-resolution
    Gu, Zheng
    Chen, Liping
    Zheng, Yanhong
    Wang, Tong
    Li, Tieying
    SIGNAL IMAGE AND VIDEO PROCESSING, 2021, 15 (06) : 1351 - 1359
  • [35] Fusion diversion network for fast, accurate and lightweight single image super-resolution
    Zheng Gu
    Liping Chen
    Yanhong Zheng
    Tong Wang
    Tieying Li
    Signal, Image and Video Processing, 2021, 15 : 1351 - 1359
  • [36] A novel lightweight multi-dimension feature fusion network for single-image super-resolution reconstruction
    Xiaoxin Guo
    Zhenchuan Tu
    Guangyu Li
    Zhengran Shen
    Weijia Wu
    The Visual Computer, 2024, 40 : 1685 - 1696
  • [37] A novel lightweight multi-dimension feature fusion network for single-image super-resolution reconstruction
    Guo, Xiaoxin
    Tu, Zhenchuan
    Li, Guangyu
    Shen, Zhengran
    Wu, Weijia
    VISUAL COMPUTER, 2024, 40 (03): : 1685 - 1696
  • [38] Lightweight Image Super-Resolution with ConvNeXt Residual Network
    Zhang, Yong
    Bai, Haomou
    Bing, Yaxing
    Liang, Xiao
    NEURAL PROCESSING LETTERS, 2023, 55 (07) : 9545 - 9561
  • [39] Lightweight subpixel sampling network for image super-resolution
    Zeng, Hongfei
    Wu, Qiang
    Zhang, Jin
    Xia, Haojie
    VISUAL COMPUTER, 2024, 40 (05): : 3781 - 3793
  • [40] LIRSRN: A Lightweight Infrared Image Super-Resolution Network
    Lin, Chun-An
    Liu, Tsung-Jung
    Liu, Kuan-Hsien
    2024 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS 2024, 2024,