MACFNet: multi-attention complementary fusion network for image denoising

被引:2
作者
Yu, Jiaolong [1 ]
Zhang, Juan [1 ]
Gao, Yongbin [1 ]
机构
[1] Shanghai Univ Engn Sci, Sch Elect & Elect Engn, 333 Longteng Rd, Shanghai 201620, Peoples R China
关键词
Image denoising; Convolutional neural network; Multi-attention mechanism; Complementary fusion; TRANSFORM; SPARSE; CNN;
D O I
10.1007/s10489-022-04313-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent years, thanks to the prosperous development of deep convolutional neural network, image denoising task has achieved unprecedented achievements. However, previous researches have difficulties in keeping the balance between noise removing and textual details preserving, even bringing the negative effect, such as local blurring. To overcome these weaknesses, in this paper, we propose an innovative multi-attention complementary fusion network (MACFNet) to restore delicate texture details while eliminating noise to the greatest extent. To be specific, our proposed MACFNet mainly composes of several multi-attention complementary fusion modules (MACFMs). Firstly, we use feature extraction block (FEB) to extract basic features.Then, we use spatial attention (SA), channel attention (CA) and patch attention (PA) three different kinds of attention mechanisms to extract spatial-dimensional, channel-dimensional and patch-dimensional attention aware features, respectively. In addition, we attempt to integrate three attention mechanisms in an effective way. Instead of directly concatenate, we design a subtle complementary fusion block (CFB), which is skilled in incorporating three sub-branches characteristics adaptively. Extensive experiments are carried out on gray-scale image denoising, color image denoising and real noisy image denoising. The quantitative results (PSNR) and visual effects all prove that our proposed network achieves great performance over some state-of-the-art methods.
引用
收藏
页码:16747 / 16761
页数:15
相关论文
共 61 条
[1]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[2]  
[Anonymous], 1999, Kodak lossless true color image suite
[3]   Real Image Denoising with Feature Attention [J].
Anwar, Saeed ;
Barnes, Nick .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3155-3164
[4]   A non-local algorithm for image denoising [J].
Buades, A ;
Coll, B ;
Morel, JM .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 2, PROCEEDINGS, 2005, :60-65
[5]  
Burger HC, 2012, PROC CVPR IEEE, P2392, DOI 10.1109/CVPR.2012.6247952
[6]   New insights into the noise reduction Wiener filter [J].
Chen, Jingdong ;
Benesty, Jacob ;
Huang, Yiteng ;
Doclo, Simon .
IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2006, 14 (04) :1218-1234
[7]   Tri-state median filter for image denoising [J].
Chen, T ;
Ma, KK ;
Chen, LH .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 1999, 8 (12) :1834-1838
[8]   Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration [J].
Chen, Yunjin ;
Pock, Thomas .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (06) :1256-1272
[9]   Image denoising by sparse 3-D transform-domain collaborative filtering [J].
Dabov, Kostadin ;
Foi, Alessandro ;
Katkovnik, Vladimir ;
Egiazarian, Karen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (08) :2080-2095
[10]   Image denoising via sparse and redundant representations over learned dictionaries [J].
Elad, Michael ;
Aharon, Michal .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2006, 15 (12) :3736-3745