Masked cross-domain self-supervised deep learning framework for photoacoustic computed tomography reconstruction

被引:3
作者
Lan, Hengrong [1 ]
Huang, Lijie [1 ]
Wei, Xingyue [1 ]
Li, Zhiqiang [1 ]
Lv, Jing [2 ]
Ma, Cheng [3 ]
Nie, Liming [2 ]
Luo, Jianwen [1 ]
机构
[1] Tsinghua Univ, Sch Biomed Engn, Beijing 100084, Peoples R China
[2] Southern Med Univ, Guangdong Prov Peoples Hosp, Med Res Inst, Guangdong Acad Med Sci, Guangzhou 510080, Peoples R China
[3] Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Inverse problem; Self-supervision; Deep learning; Photoacoustic; Transformer; IMAGE-RECONSTRUCTION; ALGORITHM;
D O I
10.1016/j.neunet.2024.106515
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Accurate image reconstruction is crucial for photoacoustic (PA) computed tomography (PACT). Recently, deep learning has been used to reconstruct PA images with a supervised scheme, which requires high-quality images as ground truth labels. However, practical implementations encounter inevitable trade-offs between cost and performance due to the expensive nature of employing additional channels for accessing more measurements. Here, we propose a masked cross-domain self-supervised (CDSS) reconstruction strategy to overcome the lack of ground truth labels from limited PA measurements. We implement the self-supervised reconstruction in a modelbased form. Simultaneously, we take advantage of self-supervision to enforce the consistency of measurements and images across three partitions of the measured PA data, achieved by randomly masking different channels. Our findings indicate that dynamically masking a substantial proportion of channels, such as 80%, yields meaningful self-supervisors in both the image and signal domains. Consequently, this approach reduces the multiplicity of pseudo solutions and enables efficient image reconstruction using fewer PA measurements, ultimately minimizing reconstruction error. Experimental results on in-vivo PACT dataset of mice demonstrate the potential of our self-supervised framework. Moreover, our method exhibits impressive performance, achieving a structural similarity index (SSIM) of 0.87 in an extreme sparse case utilizing only 13 channels, which outperforms the performance of the supervised scheme with 16 channels (0.77 SSIM). Adding to its advantages, our method can be deployed on different trainable models in an end-to-end manner, further enhancing its versatility and applicability.
引用
收藏
页数:12
相关论文
共 54 条
[1]   Towards a Fast and Safe LED-Based Photoacoustic Imaging Using Deep Convolutional Neural Network [J].
Abu Anas, Emran Mohammad ;
Zhang, Haichong K. ;
Kang, Jin ;
Boctor, Emad M. .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2018, PT IV, 2018, 11073 :159-167
[2]   Enabling fast and high quality LED photoacoustic imaging: a recurrent neural networks based approach [J].
Abu Anas, Emran Mohammad ;
Zhang, Haichong K. ;
Kang, Jin ;
Boctor, Emad .
BIOMEDICAL OPTICS EXPRESS, 2018, 9 (08) :3852-3866
[3]   Photoacoustic Source Detection and Reflection Artifact Removal Enabled by Deep Learning [J].
Allman, Derek ;
Reiter, Austin ;
Bell, Muyinatu A. Lediju .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (06) :1464-1477
[4]  
Antholzer S., 2019, SPIE, P272
[5]   Deep learning for photoacoustic tomography from sparse data [J].
Antholzer, Stephan ;
Haltmeier, Markus ;
Schwab, Johannes .
INVERSE PROBLEMS IN SCIENCE AND ENGINEERING, 2019, 27 (07) :987-1005
[6]   A review of clinical photoacoustic imaging: Current and future trends [J].
Attia, Amalina Binte Ebrahim ;
Balasundaram, Ghayathri ;
Moothanchery, Mohesh ;
Dinish, U. S. ;
Bi, Renzhe ;
Ntziachristos, Vasilis ;
Olivo, Malini .
PHOTOACOUSTICS, 2019, 16
[7]   Deep Neural Network-Based Sinogram Super-Resolution and Bandwidth Enhancement for Limited-Data Photoacoustic Tomography [J].
Awasthi, Navchetan ;
Jain, Gaurav ;
Kalva, Sandeep Kumar ;
Pramanik, Manojit ;
Yalavarthy, Phaneendra K. .
IEEE TRANSACTIONS ON ULTRASONICS FERROELECTRICS AND FREQUENCY CONTROL, 2020, 67 (12) :2660-2673
[8]   A Partially-Learned Algorithm for Joint Photo-acoustic Reconstruction and Segmentation [J].
Boink, Yoeri E. ;
Manohar, Srirang ;
Brune, Christoph .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (01) :129-139
[9]   Equivariant Imaging: Learning Beyond the Range Space [J].
Chen, Dongdong ;
Tachella, Julian ;
Davies, Mike E. .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :4359-4368
[10]  
Chen T, 2020, PR MACH LEARN RES, V119