EHNet: Efficient Hybrid Network with Dual Attention for Image Deblurring

被引:1
|
作者
Ho, Quoc-Thien [1 ]
Duong, Minh-Thien [2 ]
Lee, Seongsoo [3 ]
Hong, Min-Cheol [4 ]
机构
[1] Soongsil Univ, Dept Informat & Telecommun Engn, Seoul 06978, South Korea
[2] Ho Chi Minh City Univ Technol & Educ, Dept Automat Control, Ho Chi Minh City 70000, Vietnam
[3] Soongsil Univ, Dept Intelligent Semicond, Seoul 06978, South Korea
[4] Soongsil Univ, Sch Elect Engn, Seoul 06978, South Korea
关键词
convolution neural networks; dual attention module; hybrid architecture; image deblurring; motion blur; Transformer; TRANSFORMER;
D O I
10.3390/s24206545
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
The motion of an object or camera platform makes the acquired image blurred. This degradation is a major reason to obtain a poor-quality image from an imaging sensor. Therefore, developing an efficient deep-learning-based image processing method to remove the blur artifact is desirable. Deep learning has recently demonstrated significant efficacy in image deblurring, primarily through convolutional neural networks (CNNs) and Transformers. However, the limited receptive fields of CNNs restrict their ability to capture long-range structural dependencies. In contrast, Transformers excel at modeling these dependencies, but they are computationally expensive for high-resolution inputs and lack the appropriate inductive bias. To overcome these challenges, we propose an Efficient Hybrid Network (EHNet) that employs CNN encoders for local feature extraction and Transformer decoders with a dual-attention module to capture spatial and channel-wise dependencies. This synergy facilitates the acquisition of rich contextual information for high-quality image deblurring. Additionally, we introduce the Simple Feature-Embedding Module (SFEM) to replace the pointwise and depthwise convolutions to generate simplified embedding features in the self-attention mechanism. This innovation substantially reduces computational complexity and memory usage while maintaining overall performance. Finally, through comprehensive experiments, our compact model yields promising quantitative and qualitative results for image deblurring on various benchmark datasets.
引用
收藏
页数:23
相关论文
共 50 条
  • [21] Deep Attention-based Lightweight Network For Aerial Image Deblurring
    Wang, Suhe
    Liu, Bo
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 111 - 118
  • [22] Enhanced Image Deblurring: An Efficient Frequency Exploitation and Preservation Network
    Dong, Shuting
    Wu, Zhe
    Lu, Feng
    Yuan, Chun
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 7184 - 7193
  • [23] Efficient Blind Image Deblurring Network Based on Frequency Decomposition
    Kou, Kangkang
    Gao, Xin
    Zhang, Guoying
    Xiong, Yijin
    Nie, Fuhui
    Bai, Hanlin
    Gan, Jianwang
    IEEE SENSORS JOURNAL, 2024, 24 (14) : 23212 - 23223
  • [24] Deep Idempotent Network for Efficient Single Image Blind Deblurring
    Mao, Yuxin
    Wan, Zhexiong
    Dai, Yuchao
    Yu, Xin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (01) : 172 - 185
  • [25] Hybrid attention network for image captioning
    Jiang, Wenhui
    Li, Qin
    Zhan, Kun
    Fang, Yuming
    Shen, Fei
    DISPLAYS, 2022, 73
  • [26] HASN: hybrid attention separable network for efficient image super-resolution
    Cao, Weifeng
    Lei, Xiaoyan
    Shi, Jun
    Liang, Wanyong
    Liu, Jie
    Bai, Zongfei
    VISUAL COMPUTER, 2024, : 3423 - 3435
  • [27] Dual-former: Hybrid self-attention transformer for efficient image restoration
    Chen, Sixiang
    Ye, Tian
    Liu, Yun
    Chen, Erkang
    DIGITAL SIGNAL PROCESSING, 2024, 149
  • [28] Image deblurring method based on dual task convolution neural network
    Chen Qing-Jiang
    Hu Qian-Nan
    Li Jin-Yang
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2021, 36 (11) : 1486 - 1496
  • [29] Attention-Guided Residual Fourier Transformation Network for Single Image Deblurring
    Zhang, Huaiyuan
    PATTERN RECOGNITION AND COMPUTER VISION, PT IX, PRCV 2024, 2025, 15039 : 56 - 68
  • [30] HIGH-THROUGHPUT MICROSCOPY IMAGE DEBLURRING WITH GRAPH REASONING ATTENTION NETWORK
    Zhang, Yulun
    Wei, Donglai
    Schalek, Richard
    Wu, Yuelong
    Turney, Stephen
    Lichtman, Jeff
    Pfister, Hanspeter
    Fu, Yun
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,