Deep learning optoacoustic tomography with sparse data

被引:202
作者
Davoudi, Neda [1 ,2 ,3 ]
Dean-Ben, Xose Luis [1 ,2 ,4 ,5 ]
Razansky, Daniel [1 ,2 ,4 ,5 ]
机构
[1] Swiss Fed Inst Technol, Inst Biomed Engn, Zurich, Switzerland
[2] Swiss Fed Inst Technol, Dept Informat Technol & Elect Engn, Zurich, Switzerland
[3] Tech Univ Munich, Dept Informat, Munich, Germany
[4] Univ Zurich, Fac Med, Zurich, Switzerland
[5] Univ Zurich, Inst Pharmacol & Toxicol, Zurich, Switzerland
基金
欧洲研究理事会;
关键词
PHOTOACOUSTIC TOMOGRAPHY; RECONSTRUCTION; MODEL; PERFORMANCE; INVERSION; CANCER; BRAIN; MSOT;
D O I
10.1038/s42256-019-0095-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The rapidly evolving field of optoacoustic (photoacoustic) imaging and tomography is driven by a constant need for better imaging performance in terms of resolution, speed, sensitivity, depth and contrast. In practice, data acquisition strategies commonly involve sub-optimal sampling of the tomographic data, resulting in inevitable performance trade-offs and diminished image quality. We propose a new framework for efficient recovery of image quality from sparse optoacoustic data based on a deep convolutional neural network and demonstrate its performance with whole body mouse imaging in vivo. To generate accurate high-resolution reference images for optimal training, a full-view tomographic scanner capable of attaining superior cross-sectional image quality from living mice was devised. When provided with images reconstructed from substantially undersampled data or limited-view scans, the trained network was capable of enhancing the visibility of arbitrarily oriented structures and restoring the expected image quality. Notably, the network also eliminated some reconstruction artefacts present in reference images rendered from densely sampled data. No comparable gains were achieved when the training was performed with synthetic or phantom data, underlining the importance of training with high-quality in vivo images acquired by full-view scanners. The new method can benefit numerous optoacoustic imaging applications by mitigating common image artefacts, enhancing anatomical contrast and image quantification capacities, accelerating data acquisition and image reconstruction approaches, while also facilitating the development of practical and affordable imaging systems. The suggested approach operates solely on image-domain data and thus can be seamlessly applied to artefactual images reconstructed with other modalities. Optoacoustic imaging can achieve high spatial and temporal resolution but image quality is often compromised by suboptimal data acquisition. A new method employing deep learning to recover high-quality images from sparse or limited-view optoacoustic scans has been developed and demonstrated for whole-body mouse imaging in vivo.
引用
收藏
页码:453 / 460
页数:8
相关论文
共 58 条
[1]   Photoacoustic Source Detection and Reflection Artifact Removal Enabled by Deep Learning [J].
Allman, Derek ;
Reiter, Austin ;
Bell, Muyinatu A. Lediju .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (06) :1464-1477
[2]  
[Anonymous], 2014, PROC SPIE
[3]  
[Anonymous], 2012, DEEP LEARNING UNSUPE
[4]  
[Anonymous], 2005, PHYS REV E, DOI DOI 10.1103/PHYSREVE.71.016706
[5]   Deep learning for photoacoustic tomography from sparse data [J].
Antholzer, Stephan ;
Haltmeier, Markus ;
Schwab, Johannes .
INVERSE PROBLEMS IN SCIENCE AND ENGINEERING, 2019, 27 (07) :987-1005
[6]   Accelerated high-resolution photoacoustic tomography via compressed sensing [J].
Arridge, Simon ;
Beard, Paul ;
Betcke, Marta ;
Cox, Ben ;
Huynh, Nam ;
Lucka, Felix ;
Ogunlade, Olumide ;
Zhang, Edward .
PHYSICS IN MEDICINE AND BIOLOGY, 2016, 61 (24) :8908-8940
[7]  
Bell M. A. L., 2018, 2018 IEEE international ultrasonics symposium (IUS), P1
[8]   Photoacoustic tomography of intact human prostates and vascular texture analysis identify prostate cancer biopsy targets [J].
Bungart, Brittani L. ;
Lan, Lu ;
Wang, Pu ;
Li, Rui ;
Roch, Michael O. ;
Cheng, Liang ;
Masterson, Timothy A. ;
Dundar, Murat ;
Cheng, Ji-Xin .
PHOTOACOUSTICS, 2018, 11 :46-55
[9]   End-to-end deep neural network for optica l inversion in quantitative photoacoustic imaging [J].
Cai, Chuangjian ;
Deng, Kexin ;
Ma, Cheng ;
Luo, Jianwen .
OPTICS LETTERS, 2018, 43 (12) :2752-2755
[10]   Advanced optoacoustic methods for multiscale imaging of in vivo dynamics [J].
Dean-Ben, X. L. ;
Gottschalk, S. ;
Mc Larney, B. ;
Shoham, S. ;
Razansky, D. .
CHEMICAL SOCIETY REVIEWS, 2017, 46 (08) :2158-2198