FDU-Net: Deep Learning-Based Three-Dimensional Diffuse Optical Image Reconstruction

被引:11
作者
Deng, Bin [1 ,2 ]
Gu, Hanxue [3 ,4 ,5 ]
Zhu, Hongmin [3 ,4 ,5 ]
Chang, Ken [7 ,8 ]
Hoebel, Katharina V. V. [9 ]
Patel, Jay B. B.
Kalpathy-Cramer, Jayashree [2 ,3 ,6 ]
Carp, Stefan A. A. [1 ,2 ]
机构
[1] Massachusetts Gen Hosp MGH, Athinoula A Martinos Ctr Biomed Imaging, Charlestown, MA 02129 USA
[2] Harvard Med Sch HMS, Boston, MA 02115 USA
[3] Massachusetts Gen Hosp MGH, Martinos Ctr, Charlestown, MA 02129 USA
[4] Duke Univ, Dept Elect & Comp Engn, Durham, NC 27708 USA
[5] Amazon Com Serv LLC, People Experience & Technol, Seattle, WA 98109 USA
[6] Univ Colorado Anschutz Med Campus, Dept Ophthalmol, Aurora, CO 80045 USA
[7] Massachusetts Inst Technol MIT, Harvard MIT Div Hlth Sci & Technol HST, Cambridge, MA 02139 USA
[8] Mem Sloan Kettering Canc Ctr, Dept Med, New York, NY 10065 USA
[9] Massachusetts Inst Technol MIT, Hlth Sci & Technol HST, Cambridge, MA 02139 USA
关键词
Index Terms-Convolutional neural network; deep Learn-ing; diffuse optical tomography; inverse problem; image reconstruction; breast cancer; BREAST-CANCER; NEOADJUVANT CHEMOTHERAPY; NEURAL-NETWORKS; TOMOGRAPHY; MAMMOGRAPHY; HEALTHY; PERFORMANCE; RESOLUTION;
D O I
10.1109/TMI.2023.3252576
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Near-infrared diffuse optical tomography (DOT) is a promising functional modality for breast cancer imaging; however, the clinical translation of DOT is hampered by technical limitations. Specifically, conventional finite element method (FEM)-based optical image reconstruction approaches are time-consuming and ineffective in recovering full lesion contrast. To address this, we developed a deep learning-based reconstruction model (FDU-Net) comprised of a Fully connected subnet, followed by a convolutional encoder-Decoder subnet, and a U-Net for fast, end-to-end 3D DOT image reconstruction. The FDU-Net was trained on digital phantoms that include randomly located singular spherical inclusions of various sizes and contrasts. Reconstruction performance was evaluated in 400 simulated cases with realistic noise profiles for the FDU-Net and conventional FEM approaches. Our results show that the overall quality of images reconstructed by FDU-Net is significantly improved compared to FEM-based methods and a previously proposed deep-learning network. Importantly, once trained, FDU-Net demonstrates substantially better capability to recover true inclusion contrast and location without using any inclusion information during reconstruction. The model was also generalizable to multi-focal and irregularly shaped inclusions unseen during training. Finally, FDU-Net, trained on simulated data, could successfully reconstruct a breast tumor from a real patient measurement. Overall, our deep learning-based approach demonstrates marked superiority over the conventional DOT image reconstruction methods while also offering over four orders of magnitude acceleration in computational time. Once adapted to the clinical breast imaging workflow, FDU-Net has the potential to provide real-time accurate lesion characterization by DOT to assist the clinical diagnosis and management of breast cancer.
引用
收藏
页码:2439 / 2450
页数:12
相关论文
共 53 条
  • [1] Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
  • [2] Diffuse optical tomography reconstruction method using ultrasound images as prior for regularization matrix
    Althobaiti, Murad
    Vavadi, Hamed
    Zhu, Quing
    [J]. JOURNAL OF BIOMEDICAL OPTICS, 2017, 22 (02)
  • [3] Optical tomography: forward and inverse problems
    Arridge, Simon R.
    Schotland, John C.
    [J]. INVERSE PROBLEMS, 2009, 25 (12)
  • [4] Deep Learning Based Image Reconstruction for Diffuse Optical Tomography
    Ben Yedder, Hanene
    BenTaieb, Aicha
    Shokoufi, Majid
    Zahiremami, Amir
    Golnaraghi, Farid
    Hamarneh, Ghassan
    [J]. MACHINE LEARNING FOR MEDICAL IMAGE RECONSTRUCTION, MLMIR 2018, 2018, 11074 : 112 - 119
  • [5] Imaging the body with diffuse optical tomography
    Boas, DA
    Brooks, DH
    Miller, EL
    DiMarzio, CA
    Kilmer, M
    Gaudette, RJ
    Zhang, Q
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2001, 18 (06) : 57 - 75
  • [6] End-to-end deep neural network for optica l inversion in quantitative photoacoustic imaging
    Cai, Chuangjian
    Deng, Kexin
    Ma, Cheng
    Luo, Jianwen
    [J]. OPTICS LETTERS, 2018, 43 (12) : 2752 - 2755
  • [7] Development of digital breast tomosynthesis and diffuse optical tomography fusion imaging for breast cancer detection
    Chae, Eun Young
    Kim, Hak Hee
    Sabir, Sohail
    Kim, Yejin
    Kim, Hyeongseok
    Yoon, Sungho
    Ye, Jong Chul
    Cho, Seungryong
    Heo, Duchang
    Kim, Kee Hyun
    Bae, Young Min
    Choi, Young-Wook
    [J]. SCIENTIFIC REPORTS, 2020, 10 (01)
  • [8] Diffuse optical tomography of breast cancer during neoadjuvant chemotherapy: A case study with comparison to MRI
    Choe, R
    Corlu, A
    Lee, K
    Durduran, T
    Konecky, SD
    Grosicka-Koptyra, M
    Arridge, SR
    Czerniecki, BJ
    Fraker, DL
    DeMichele, A
    Chance, B
    Rosen, MA
    Yodh, AG
    [J]. MEDICAL PHYSICS, 2005, 32 (04) : 1128 - 1139
  • [9] Differentiation of benign and malignant breast tumors by in-vivo three-dimensional parallel-plate diffuse optical tomography
    Choe, Regine
    Konecky, Soren D.
    Corlu, Alper
    Lee, Kijoon
    Durduran, Turgut
    Busch, David R.
    Pathak, Saurav
    Czerniecki, Brian J.
    Tchou, Julia
    Fraker, Douglas L.
    DeMichele, Angela
    Chance, Britton
    Arridge, Simon R.
    Schweiger, Martin
    Culver, Joseph P.
    Schnall, Mitchell D.
    Putt, Mary E.
    Rosen, Mark A.
    Yodh, Arjun G.
    [J]. JOURNAL OF BIOMEDICAL OPTICS, 2009, 14 (02)
  • [10] Cicek Ozgun, 2016, Medical Image Computing and Computer-Assisted Intervention - MICCAI 2016. 19th International Conference. Proceedings: LNCS 9901, P424, DOI 10.1007/978-3-319-46723-8_49