FDU-Net: Deep Learning-Based Three-Dimensional Diffuse Optical Image Reconstruction

被引:14
作者
Deng, Bin [1 ,2 ]
Gu, Hanxue [3 ,4 ,5 ]
Zhu, Hongmin [3 ,4 ,5 ]
Chang, Ken [7 ,8 ]
Hoebel, Katharina V. V. [9 ]
Patel, Jay B. B.
Kalpathy-Cramer, Jayashree [2 ,3 ,6 ]
Carp, Stefan A. A. [1 ,2 ]
机构
[1] Massachusetts Gen Hosp MGH, Athinoula A Martinos Ctr Biomed Imaging, Charlestown, MA 02129 USA
[2] Harvard Med Sch HMS, Boston, MA 02115 USA
[3] Massachusetts Gen Hosp MGH, Martinos Ctr, Charlestown, MA 02129 USA
[4] Duke Univ, Dept Elect & Comp Engn, Durham, NC 27708 USA
[5] Amazon Com Serv LLC, People Experience & Technol, Seattle, WA 98109 USA
[6] Univ Colorado Anschutz Med Campus, Dept Ophthalmol, Aurora, CO 80045 USA
[7] Massachusetts Inst Technol MIT, Harvard MIT Div Hlth Sci & Technol HST, Cambridge, MA 02139 USA
[8] Mem Sloan Kettering Canc Ctr, Dept Med, New York, NY 10065 USA
[9] Massachusetts Inst Technol MIT, Hlth Sci & Technol HST, Cambridge, MA 02139 USA
关键词
Index Terms-Convolutional neural network; deep Learn-ing; diffuse optical tomography; inverse problem; image reconstruction; breast cancer; BREAST-CANCER; NEOADJUVANT CHEMOTHERAPY; NEURAL-NETWORKS; TOMOGRAPHY; MAMMOGRAPHY; HEALTHY; PERFORMANCE; RESOLUTION;
D O I
10.1109/TMI.2023.3252576
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Near-infrared diffuse optical tomography (DOT) is a promising functional modality for breast cancer imaging; however, the clinical translation of DOT is hampered by technical limitations. Specifically, conventional finite element method (FEM)-based optical image reconstruction approaches are time-consuming and ineffective in recovering full lesion contrast. To address this, we developed a deep learning-based reconstruction model (FDU-Net) comprised of a Fully connected subnet, followed by a convolutional encoder-Decoder subnet, and a U-Net for fast, end-to-end 3D DOT image reconstruction. The FDU-Net was trained on digital phantoms that include randomly located singular spherical inclusions of various sizes and contrasts. Reconstruction performance was evaluated in 400 simulated cases with realistic noise profiles for the FDU-Net and conventional FEM approaches. Our results show that the overall quality of images reconstructed by FDU-Net is significantly improved compared to FEM-based methods and a previously proposed deep-learning network. Importantly, once trained, FDU-Net demonstrates substantially better capability to recover true inclusion contrast and location without using any inclusion information during reconstruction. The model was also generalizable to multi-focal and irregularly shaped inclusions unseen during training. Finally, FDU-Net, trained on simulated data, could successfully reconstruct a breast tumor from a real patient measurement. Overall, our deep learning-based approach demonstrates marked superiority over the conventional DOT image reconstruction methods while also offering over four orders of magnitude acceleration in computational time. Once adapted to the clinical breast imaging workflow, FDU-Net has the potential to provide real-time accurate lesion characterization by DOT to assist the clinical diagnosis and management of breast cancer.
引用
收藏
页码:2439 / 2450
页数:12
相关论文
共 53 条
[1]  
Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
[2]   Diffuse optical tomography reconstruction method using ultrasound images as prior for regularization matrix [J].
Althobaiti, Murad ;
Vavadi, Hamed ;
Zhu, Quing .
JOURNAL OF BIOMEDICAL OPTICS, 2017, 22 (02)
[3]   Optical tomography: forward and inverse problems [J].
Arridge, Simon R. ;
Schotland, John C. .
INVERSE PROBLEMS, 2009, 25 (12)
[4]   Deep Learning Based Image Reconstruction for Diffuse Optical Tomography [J].
Ben Yedder, Hanene ;
BenTaieb, Aicha ;
Shokoufi, Majid ;
Zahiremami, Amir ;
Golnaraghi, Farid ;
Hamarneh, Ghassan .
MACHINE LEARNING FOR MEDICAL IMAGE RECONSTRUCTION, MLMIR 2018, 2018, 11074 :112-119
[5]   Imaging the body with diffuse optical tomography [J].
Boas, DA ;
Brooks, DH ;
Miller, EL ;
DiMarzio, CA ;
Kilmer, M ;
Gaudette, RJ ;
Zhang, Q .
IEEE SIGNAL PROCESSING MAGAZINE, 2001, 18 (06) :57-75
[6]   End-to-end deep neural network for optica l inversion in quantitative photoacoustic imaging [J].
Cai, Chuangjian ;
Deng, Kexin ;
Ma, Cheng ;
Luo, Jianwen .
OPTICS LETTERS, 2018, 43 (12) :2752-2755
[7]   Development of digital breast tomosynthesis and diffuse optical tomography fusion imaging for breast cancer detection [J].
Chae, Eun Young ;
Kim, Hak Hee ;
Sabir, Sohail ;
Kim, Yejin ;
Kim, Hyeongseok ;
Yoon, Sungho ;
Ye, Jong Chul ;
Cho, Seungryong ;
Heo, Duchang ;
Kim, Kee Hyun ;
Bae, Young Min ;
Choi, Young-Wook .
SCIENTIFIC REPORTS, 2020, 10 (01)
[8]   Diffuse optical tomography of breast cancer during neoadjuvant chemotherapy: A case study with comparison to MRI [J].
Choe, R ;
Corlu, A ;
Lee, K ;
Durduran, T ;
Konecky, SD ;
Grosicka-Koptyra, M ;
Arridge, SR ;
Czerniecki, BJ ;
Fraker, DL ;
DeMichele, A ;
Chance, B ;
Rosen, MA ;
Yodh, AG .
MEDICAL PHYSICS, 2005, 32 (04) :1128-1139
[9]   Differentiation of benign and malignant breast tumors by in-vivo three-dimensional parallel-plate diffuse optical tomography [J].
Choe, Regine ;
Konecky, Soren D. ;
Corlu, Alper ;
Lee, Kijoon ;
Durduran, Turgut ;
Busch, David R. ;
Pathak, Saurav ;
Czerniecki, Brian J. ;
Tchou, Julia ;
Fraker, Douglas L. ;
DeMichele, Angela ;
Chance, Britton ;
Arridge, Simon R. ;
Schweiger, Martin ;
Culver, Joseph P. ;
Schnall, Mitchell D. ;
Putt, Mary E. ;
Rosen, Mark A. ;
Yodh, Arjun G. .
JOURNAL OF BIOMEDICAL OPTICS, 2009, 14 (02)
[10]  
Cicek Ozgun, 2016, Medical Image Computing and Computer-Assisted Intervention - MICCAI 2016. 19th International Conference. Proceedings: LNCS 9901, P424, DOI 10.1007/978-3-319-46723-8_49