Deep Neural Network-Based Sinogram Super-Resolution and Bandwidth Enhancement for Limited-Data Photoacoustic Tomography

被引:75
作者
Awasthi, Navchetan [1 ,2 ,3 ]
Jain, Gaurav [1 ,4 ]
Kalva, Sandeep Kumar [5 ,6 ]
Pramanik, Manojit [5 ]
Yalavarthy, Phaneendra K. [1 ]
机构
[1] Indian Inst Sci, Dept Computat & Data Sci, Bengaluru 560012, India
[2] Massachusetts Gen Hosp, Boston, MA 02114 USA
[3] Harvard Univ, Cambridge, MA 02138 USA
[4] Delhi Technol Univ, Dept Comp Sci & Engn, New Delhi 110042, India
[5] Nanyang Technol Univ, Sch Chem & Biomed Engn, Singapore 637459, Singapore
[6] Univ Zurich, CH-8006 Zurich, Switzerland
关键词
Image reconstruction; Image resolution; Transducers; Acoustics; Bandwidth; Imaging; Neural networks; Bandwidth (BW) enhancement; convolutional neural networks; image reconstruction; photoacoustic (PA) imaging; super-resolution; IMAGE-RECONSTRUCTION; DECONVOLUTION; SEGMENTATION; RESOLUTION;
D O I
10.1109/TUFFC.2020.2977210
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Photoacoustic tomography (PAT) is a noninvasive imaging modality combining the benefits of optical contrast at ultrasonic resolution. Analytical reconstruction algorithms for photoacoustic (PA) signals require a large number of data points for accurate image reconstruction. However, in practical scenarios, data are collected using the limited number of transducers along with data being often corrupted with noise resulting in only qualitative images. Furthermore, the collected boundary data are band-limited due to limited bandwidth (BW) of the transducer, making the PA imaging with limited data being qualitative. In this work, a deep neural network-based model with loss function being scaled root-mean-squared error was proposed for super-resolution, denoising, as well as BW enhancement of the PA signals collected at the boundary of the domain. The proposed network has been compared with traditional as well as other popular deep-learning methods in numerical as well as experimental cases and is shown to improve the collected boundary data, in turn, providing superior quality reconstructed PA image. The improvement obtained in the Pearson correlation, structural similarity index metric, and root-mean-square error was as high as 35.62%, 33.81%, and 41.07%, respectively, for phantom cases and signal-to-noise ratio improvement in the reconstructed PA images was as high as 11.65 dB for in vivo cases compared with reconstructed image obtained using original limited BW data. Code is available at https://sites.google.com/site/sercmig/home/dnnpat.
引用
收藏
页码:2660 / 2673
页数:14
相关论文
共 74 条
[1]   Photoacoustic Source Detection and Reflection Artifact Removal Enabled by Deep Learning [J].
Allman, Derek ;
Reiter, Austin ;
Bell, Muyinatu A. Lediju .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (06) :1464-1477
[2]  
[Anonymous], 2018, Mixed precision training
[3]  
[Anonymous], 2016, LECT NOTES COMPUT SC, DOI DOI 10.1007/978-3-319-46976-8_21
[4]   Deep learning for photoacoustic tomography from sparse data [J].
Antholzer, Stephan ;
Haltmeier, Markus ;
Schwab, Johannes .
INVERSE PROBLEMS IN SCIENCE AND ENGINEERING, 2019, 27 (07) :987-1005
[5]   Imaging from coupled physics FOREWORD [J].
Arridge, S. R. ;
Scherzer, O. .
INVERSE PROBLEMS, 2012, 28 (08)
[6]   Accelerated high-resolution photoacoustic tomography via compressed sensing [J].
Arridge, Simon ;
Beard, Paul ;
Betcke, Marta ;
Cox, Ben ;
Huynh, Nam ;
Lucka, Felix ;
Ogunlade, Olumide ;
Zhang, Edward .
PHYSICS IN MEDICINE AND BIOLOGY, 2016, 61 (24) :8908-8940
[7]   On the adjoint operator in photoacoustic tomography [J].
Arridge, Simon R. ;
Betcke, Marta M. ;
Cox, Ben T. ;
Lucka, Felix ;
Treeby, Brad E. .
INVERSE PROBLEMS, 2016, 32 (11)
[8]   Deep learning-based detection of motion artifacts in probe-based confocal laser endomicroscopy images [J].
Aubreville, Marc ;
Stoeve, Maike ;
Oetter, Nicolai ;
Goncalves, Miguel ;
Knipfer, Christian ;
Neumann, Helmut ;
Bohr, Christopher ;
Stelzle, Florian ;
Maier, Andreas .
INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2019, 14 (01) :31-42
[9]  
Awasthi N., 2020, ARXIV200106434
[10]   PA-Fuse: deep supervised approach for the fusion of photoacoustic images with distinct reconstruction characteristics [J].
Awasthi, Navchetan ;
Prabhakar, K. Ram ;
Kalva, Sandeep Kumar ;
Pramanik, Manojit ;
Babu, R. Venkatesh ;
Yalavarthy, Phaneendra K. .
BIOMEDICAL OPTICS EXPRESS, 2019, 10 (05) :2242-2258