De-Noising of Photoacoustic Microscopy Images by Attentive Generative Adversarial Network

被引:25
作者
He, Da [1 ]
Zhou, Jiasheng [1 ,2 ]
Shang, Xiaoyu [1 ]
Tang, Xingye [1 ]
Luo, Jiajia [3 ,4 ,5 ]
Chen, Sung-Liang [1 ,6 ,7 ]
机构
[1] Shanghai Jiao Tong Univ, Univ Michigan Shanghai Jiao Tong Univ Joint Inst, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Inst Med Robot, Shanghai 200240, Peoples R China
[3] Peking Univ, Hlth Sci Ctr, Inst Med Technol, Beijing 100191, Peoples R China
[4] Peking Univ, Biomed Engn Dept, Beijing 100191, Peoples R China
[5] Peking Univ Peoples Hosp, Beijing 100044, Peoples R China
[6] Minist Educ, Engn Res Ctr Digital Med & Clin Translat, Shanghai 200030, Peoples R China
[7] Shanghai Jiao Tong Univ, State Key Lab Adv Opt Commun Syst & Networks, Shanghai 200240, Peoples R China
基金
上海市自然科学基金; 中国国家自然科学基金;
关键词
Photoacoustic microscopy; de-nosing; generative adversarial network; deep learning; ENHANCEMENT; TOMOGRAPHY; DISTANCE; REMOVAL;
D O I
10.1109/TMI.2022.3227105
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
As a hybrid imaging technology, photoacoustic microscopy (PAM) imaging suffers from noise due to the maximum permissible exposure of laser intensity, attenuation of ultrasound in the tissue, and the inherent noise of the transducer. De-noising is an image processing method to reduce noise, and PAM image quality can be recovered. However, previous de-noising techniques usually heavily rely on manually selected parameters, resulting in unsatisfactory and slow de-noising performance for different noisy images, which greatly hinders practical and clinical applications. In this work, we propose a deep learning-based method to remove noise from PAM images without manual selection of settings for different noisy images. An attention enhanced generative adversarial network is used to extract image features and adaptively remove various levels of Gaussian, Poisson, and Rayleigh noise. The proposed method is demonstrated on both synthetic and real datasets, including phantom (leaf veins) and in vivo (mouse ear blood vessels and zebrafish pigment) experiments. In the in vivo experiments using synthetic datasets, our method achieves the improvement of 6.53 dB and 0.26 in peak signal-to-noise ratio and structural similarity metrics, respectively. The results show that compared with previous PAM de-noising methods, ourmethod exhibits good performance in recovering images qualitatively and quantitatively. In addition, the de-noising processing speed of 0.016 s is achieved for an image with 256 x 256 pixels, which has the potential for real-time applications. Our approach is effective and practical for the de-noising of PAM images.
引用
收藏
页码:1349 / 1362
页数:14
相关论文
共 52 条
[1]   K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation [J].
Aharon, Michal ;
Elad, Michael ;
Bruckstein, Alfred .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2006, 54 (11) :4311-4322
[2]   Photoacoustic Source Detection and Reflection Artifact Removal Enabled by Deep Learning [J].
Allman, Derek ;
Reiter, Austin ;
Bell, Muyinatu A. Lediju .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (06) :1464-1477
[3]   Super Wide-Field Photoacoustic Microscopy of Animals and Humans <italic>In Vivo</italic> [J].
Baik, Jin Woo ;
Kim, Jin Young ;
Cho, Seonghee ;
Choi, Seongwook ;
Kim, Jongbeom ;
Kim, Chulhong .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (04) :975-984
[4]   Spread Spectrum Photoacoustic Tomography With Image Optimization [J].
Cao, Meng ;
Feng, Ting ;
Yuan, Jie ;
Xu, Guan ;
Wang, Xueding ;
Carson, Paul L. .
IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS, 2017, 11 (02) :411-419
[5]   GCNet: Non-local Networks Meet Squeeze-Excitation Networks and Beyond [J].
Cao, Yue ;
Xu, Jiarui ;
Lin, Stephen ;
Wei, Fangyun ;
Hu, Han .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, :1971-1980
[6]   Image Blind Denoising With Generative Adversarial Network Based Noise Modeling [J].
Chen, Jingwen ;
Chen, Jiawei ;
Chao, Hongyang ;
Yang, Ming .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :3155-3164
[7]   New maximum likelihood motion estimation schemes for noisy ultrasound images [J].
Cohen, B ;
Dinstein, I .
PATTERN RECOGNITION, 2002, 35 (02) :455-463
[8]   Image denoising by sparse 3-D transform-domain collaborative filtering [J].
Dabov, Kostadin ;
Foi, Alessandro ;
Katkovnik, Vladimir ;
Egiazarian, Karen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (08) :2080-2095
[9]   Deep learning optoacoustic tomography with sparse data [J].
Davoudi, Neda ;
Dean-Ben, Xose Luis ;
Razansky, Daniel .
NATURE MACHINE INTELLIGENCE, 2019, 1 (10) :453-460
[10]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672