Deep learning optoacoustic tomography with sparse data

被引:185
作者
Davoudi, Neda [1 ,2 ,3 ]
Dean-Ben, Xose Luis [1 ,2 ,4 ,5 ]
Razansky, Daniel [1 ,2 ,4 ,5 ]
机构
[1] Swiss Fed Inst Technol, Inst Biomed Engn, Zurich, Switzerland
[2] Swiss Fed Inst Technol, Dept Informat Technol & Elect Engn, Zurich, Switzerland
[3] Tech Univ Munich, Dept Informat, Munich, Germany
[4] Univ Zurich, Fac Med, Zurich, Switzerland
[5] Univ Zurich, Inst Pharmacol & Toxicol, Zurich, Switzerland
基金
欧洲研究理事会;
关键词
PHOTOACOUSTIC TOMOGRAPHY; RECONSTRUCTION; MODEL; PERFORMANCE; INVERSION; CANCER; BRAIN; MSOT;
D O I
10.1038/s42256-019-0095-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The rapidly evolving field of optoacoustic (photoacoustic) imaging and tomography is driven by a constant need for better imaging performance in terms of resolution, speed, sensitivity, depth and contrast. In practice, data acquisition strategies commonly involve sub-optimal sampling of the tomographic data, resulting in inevitable performance trade-offs and diminished image quality. We propose a new framework for efficient recovery of image quality from sparse optoacoustic data based on a deep convolutional neural network and demonstrate its performance with whole body mouse imaging in vivo. To generate accurate high-resolution reference images for optimal training, a full-view tomographic scanner capable of attaining superior cross-sectional image quality from living mice was devised. When provided with images reconstructed from substantially undersampled data or limited-view scans, the trained network was capable of enhancing the visibility of arbitrarily oriented structures and restoring the expected image quality. Notably, the network also eliminated some reconstruction artefacts present in reference images rendered from densely sampled data. No comparable gains were achieved when the training was performed with synthetic or phantom data, underlining the importance of training with high-quality in vivo images acquired by full-view scanners. The new method can benefit numerous optoacoustic imaging applications by mitigating common image artefacts, enhancing anatomical contrast and image quantification capacities, accelerating data acquisition and image reconstruction approaches, while also facilitating the development of practical and affordable imaging systems. The suggested approach operates solely on image-domain data and thus can be seamlessly applied to artefactual images reconstructed with other modalities. Optoacoustic imaging can achieve high spatial and temporal resolution but image quality is often compromised by suboptimal data acquisition. A new method employing deep learning to recover high-quality images from sparse or limited-view optoacoustic scans has been developed and demonstrated for whole-body mouse imaging in vivo.
引用
收藏
页码:453 / 460
页数:8
相关论文
共 58 条
  • [1] Photoacoustic Source Detection and Reflection Artifact Removal Enabled by Deep Learning
    Allman, Derek
    Reiter, Austin
    Bell, Muyinatu A. Lediju
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (06) : 1464 - 1477
  • [2] [Anonymous], 2014, PROC SPIE
  • [3] [Anonymous], 2012, DEEP LEARNING UNSUPE
  • [4] [Anonymous], 2005, PHYS REV E, DOI DOI 10.1103/PHYSREVE.71.016706
  • [5] Deep learning for photoacoustic tomography from sparse data
    Antholzer, Stephan
    Haltmeier, Markus
    Schwab, Johannes
    [J]. INVERSE PROBLEMS IN SCIENCE AND ENGINEERING, 2019, 27 (07) : 987 - 1005
  • [6] Accelerated high-resolution photoacoustic tomography via compressed sensing
    Arridge, Simon
    Beard, Paul
    Betcke, Marta
    Cox, Ben
    Huynh, Nam
    Lucka, Felix
    Ogunlade, Olumide
    Zhang, Edward
    [J]. PHYSICS IN MEDICINE AND BIOLOGY, 2016, 61 (24) : 8908 - 8940
  • [7] Bell M. A. L., 2018, 2018 IEEE international ultrasonics symposium (IUS), P1
  • [8] Photoacoustic tomography of intact human prostates and vascular texture analysis identify prostate cancer biopsy targets
    Bungart, Brittani L.
    Lan, Lu
    Wang, Pu
    Li, Rui
    Roch, Michael O.
    Cheng, Liang
    Masterson, Timothy A.
    Dundar, Murat
    Cheng, Ji-Xin
    [J]. PHOTOACOUSTICS, 2018, 11 : 46 - 55
  • [9] End-to-end deep neural network for optica l inversion in quantitative photoacoustic imaging
    Cai, Chuangjian
    Deng, Kexin
    Ma, Cheng
    Luo, Jianwen
    [J]. OPTICS LETTERS, 2018, 43 (12) : 2752 - 2755
  • [10] Advanced optoacoustic methods for multiscale imaging of in vivo dynamics
    Dean-Ben, X. L.
    Gottschalk, S.
    Mc Larney, B.
    Shoham, S.
    Razansky, D.
    [J]. CHEMICAL SOCIETY REVIEWS, 2017, 46 (08) : 2158 - 2198