MACFNet: multi-attention complementary fusion network for image denoising

被引:2
作者
Yu, Jiaolong [1 ]
Zhang, Juan [1 ]
Gao, Yongbin [1 ]
机构
[1] Shanghai Univ Engn Sci, Sch Elect & Elect Engn, 333 Longteng Rd, Shanghai 201620, Peoples R China
关键词
Image denoising; Convolutional neural network; Multi-attention mechanism; Complementary fusion; TRANSFORM; SPARSE; CNN;
D O I
10.1007/s10489-022-04313-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent years, thanks to the prosperous development of deep convolutional neural network, image denoising task has achieved unprecedented achievements. However, previous researches have difficulties in keeping the balance between noise removing and textual details preserving, even bringing the negative effect, such as local blurring. To overcome these weaknesses, in this paper, we propose an innovative multi-attention complementary fusion network (MACFNet) to restore delicate texture details while eliminating noise to the greatest extent. To be specific, our proposed MACFNet mainly composes of several multi-attention complementary fusion modules (MACFMs). Firstly, we use feature extraction block (FEB) to extract basic features.Then, we use spatial attention (SA), channel attention (CA) and patch attention (PA) three different kinds of attention mechanisms to extract spatial-dimensional, channel-dimensional and patch-dimensional attention aware features, respectively. In addition, we attempt to integrate three attention mechanisms in an effective way. Instead of directly concatenate, we design a subtle complementary fusion block (CFB), which is skilled in incorporating three sub-branches characteristics adaptively. Extensive experiments are carried out on gray-scale image denoising, color image denoising and real noisy image denoising. The quantitative results (PSNR) and visual effects all prove that our proposed network achieves great performance over some state-of-the-art methods.
引用
收藏
页码:16747 / 16761
页数:15
相关论文
共 61 条
[31]   Multi-Scale Self-Guided Attention for Medical Image Segmentation [J].
Sinha, Ashish ;
Dolz, Jose .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2021, 25 (01) :121-130
[32]   MemNet: A Persistent Memory Network for Image Restoration [J].
Tai, Ying ;
Yang, Jian ;
Liu, Xiaoming ;
Xu, Chunyan .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :4549-4557
[33]   Designing and training of a dual CNN for image denoising [J].
Tian, Chunwei ;
Xu, Yong ;
Zuo, Wangmeng ;
Du, Bo ;
Lin, Chia-Wen ;
Zhang, David .
KNOWLEDGE-BASED SYSTEMS, 2021, 226 (226)
[34]   Enhanced CNN for image denoising [J].
Tian, Chunwei ;
Xu, Yong ;
Fei, Lunke ;
Wang, Junqian ;
Wen, Jie ;
Luo, Nan .
CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2019, 4 (01) :17-23
[35]   Bilateral filtering for gray and color images [J].
Tomasi, C ;
Manduchi, R .
SIXTH INTERNATIONAL CONFERENCE ON COMPUTER VISION, 1998, :839-846
[36]   Residual Attention Network for Image Classification [J].
Wang, Fei ;
Jiang, Mengqing ;
Qian, Chen ;
Yang, Shuo ;
Li, Cheng ;
Zhang, Honggang ;
Wang, Xiaogang ;
Tang, Xiaoou .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6450-6458
[37]   Dilated Deep Residual Network for Image Denoising [J].
Wang, Tianyang ;
Sun, Mingxuan ;
Hu, Kaoning .
2017 IEEE 29TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2017), 2017, :1272-1279
[38]   Moving window-based double Haar wavelet transform for image processing [J].
Wang, Xin .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2006, 15 (09) :2771-2779
[39]   Channel and Space Attention Neural Network for Image Denoising [J].
Wang, Yi ;
Song, Xiao ;
Chen, Kai .
IEEE SIGNAL PROCESSING LETTERS, 2021, 28 :424-428
[40]   Revisiting Convolutional Sparse Coding for Image Denoising: From a Multi-Scale Perspective [J].
Xu, Jingyi ;
Deng, Xin ;
Xu, Mai .
IEEE SIGNAL PROCESSING LETTERS, 2022, 29 :1202-1206