MACFNet: multi-attention complementary fusion network for image denoising

被引:2
作者
Yu, Jiaolong [1 ]
Zhang, Juan [1 ]
Gao, Yongbin [1 ]
机构
[1] Shanghai Univ Engn Sci, Sch Elect & Elect Engn, 333 Longteng Rd, Shanghai 201620, Peoples R China
关键词
Image denoising; Convolutional neural network; Multi-attention mechanism; Complementary fusion; TRANSFORM; SPARSE; CNN;
D O I
10.1007/s10489-022-04313-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent years, thanks to the prosperous development of deep convolutional neural network, image denoising task has achieved unprecedented achievements. However, previous researches have difficulties in keeping the balance between noise removing and textual details preserving, even bringing the negative effect, such as local blurring. To overcome these weaknesses, in this paper, we propose an innovative multi-attention complementary fusion network (MACFNet) to restore delicate texture details while eliminating noise to the greatest extent. To be specific, our proposed MACFNet mainly composes of several multi-attention complementary fusion modules (MACFMs). Firstly, we use feature extraction block (FEB) to extract basic features.Then, we use spatial attention (SA), channel attention (CA) and patch attention (PA) three different kinds of attention mechanisms to extract spatial-dimensional, channel-dimensional and patch-dimensional attention aware features, respectively. In addition, we attempt to integrate three attention mechanisms in an effective way. Instead of directly concatenate, we design a subtle complementary fusion block (CFB), which is skilled in incorporating three sub-branches characteristics adaptively. Extensive experiments are carried out on gray-scale image denoising, color image denoising and real noisy image denoising. The quantitative results (PSNR) and visual effects all prove that our proposed network achieves great performance over some state-of-the-art methods.
引用
收藏
页码:16747 / 16761
页数:15
相关论文
共 61 条
[21]   Multi-level Wavelet-CNN for Image Restoration [J].
Liu, Pengju ;
Zhang, Hongzhi ;
Zhang, Kai ;
Lin, Liang ;
Zuo, Wangmeng .
PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, :886-895
[22]   Multiple Kernel k-Means with Incomplete Kernels [J].
Liu, Xinwang ;
Zhu, Xinzhong ;
Li, Miaomiao ;
Wang, Lei ;
Zhu, En ;
Liu, Tongliang ;
Kloft, Marius ;
Shen, Dinggang ;
Yin, Jianping ;
Gao, Wen .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (05) :1191-1204
[23]   Non-local Sparse Models for Image Restoration [J].
Mairal, Julien ;
Bach, Francis ;
Ponce, Jean ;
Sapiro, Guillermo ;
Zisserman, Andrew .
2009 IEEE 12TH INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2009, :2272-2279
[24]  
Mao XJ, 2016, ADV NEUR IN, V29
[25]  
Martin D, 2001, EIGHTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOL II, PROCEEDINGS, P416, DOI 10.1109/ICCV.2001.937655
[26]   COLA-Net: Collaborative Attention Network for Image Restoration [J].
Mou, Chong ;
Zhang, Jian ;
Fan, Xiaopeng ;
Liu, Hangfan ;
Wang, Ronggang .
IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 :1366-1377
[27]   A novel blind source separation technique using fractional Fourier transform for denoising medical images [J].
Mustafi, A. ;
Ghorai, S. K. .
OPTIK, 2013, 124 (03) :265-271
[28]  
Pltz T., 2018, Advances in Neural Information Processing Systems, V31, P1095
[29]   Adaptive Consistency Prior based Deep Network for Image Denoising [J].
Ren, Chao ;
He, Xiaohai ;
Wang, Chuncheng ;
Zhao, Zhibo .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :8592-8602
[30]   A competent image denoising method based on structural information extraction [J].
Shi, Miaowen ;
Fan, Linwei ;
Li, Xuemei ;
Zhang, Caiming .
VISUAL COMPUTER, 2023, 39 (06) :2407-2423