UHR-DeepFMT: Ultra-High Spatial Resolution Reconstruction of Fluorescence Molecular Tomography Based on 3-D Fusion Dual-Sampling Deep Neural Network

被引:52
作者
Zhang, Peng [1 ,2 ]
Fan, Guangda [1 ,2 ]
Xing, Tongtong [1 ,2 ]
Song, Fan [1 ,2 ]
Zhang, Guanglei [1 ,2 ]
机构
[1] Beihang Univ, Beijing Adv Innovat Ctr Biomed Engn, Beijing 100191, Peoples R China
[2] Beihang Univ, Sch Biol Sci & Med Engn, Beijing 100191, Peoples R China
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Image reconstruction; Spatial resolution; Fluorescence; Mathematical model; Inverse problems; Three-dimensional displays; Photonics; Fluorescence tomography; image reconstruction; spatial resolution; TOTAL VARIATION REGULARIZATION; OPTICAL TOMOGRAPHY; LIGHT;
D O I
10.1109/TMI.2021.3071556
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Fluorescence molecular tomography (FMT) is a promising and high sensitivity imaging modality that can reconstruct the three-dimensional (3D) distribution of interior fluorescent sources. However, the spatial resolution of FMT has encountered an insurmountable bottleneck and cannot be substantially improved, due to the simplified forward model and the severely ill-posed inverse problem. In this work, a 3D fusion dual-sampling convolutional neural network, namely UHR-DeepFMT, was proposed to achieve ultra-high spatial resolution reconstruction of FMT. Under this framework, the UHR-DeepFMT does not need to explicitly solve the FMT forward and inverse problems. Instead, it directly establishes an end-to-end mapping model to reconstruct the fluorescent sources, which can enormously eliminate the modeling errors. Besides, a novel fusion mechanism that integrates the dual-sampling strategy and the squeeze-and-excitation (SE) module is introduced into the skip connection of UHR-DeepFMT, which can significantly improve the spatial resolution by greatly alleviating the ill-posedness of the inverse problem. To evaluate the performance of UHR-DeepFMT network model, numerical simulations, physical phantom and in vivo experiments were conducted. The results demonstrated that the proposed UHR-DeepFMT can outperform the cutting-edge methods and achieve ultra-high spatial resolution reconstruction of FMT with the powerful ability to distinguish adjacent targets with a minimal edge-to-edge distance (EED) of 0.5 mm. It is assumed that this research is a significant improvement for FMT in terms of spatial resolution and overall imaging quality, which could promote the precise diagnosis and preclinical application of small animals in the future.
引用
收藏
页码:3217 / 3228
页数:12
相关论文
共 42 条
[1]   Optical tomography in medical imaging [J].
Arridge, SR .
INVERSE PROBLEMS, 1999, 15 (02) :R41-R93
[2]   Adaptive finite element methods for the solution of inverse problems in optical tomography [J].
Bangerth, Wolfgang ;
Joshi, Amit .
INVERSE PROBLEMS, 2008, 24 (03)
[3]   End-to-end deep neural network for optica l inversion in quantitative photoacoustic imaging [J].
Cai, Chuangjian ;
Deng, Kexin ;
Ma, Cheng ;
Luo, Jianwen .
OPTICS LETTERS, 2018, 43 (12) :2752-2755
[4]   NIR-II/NIR-I Fluorescence Molecular Tomography of Heterogeneous Mice Based on Gaussian Weighted Neighborhood Fused Lasso Method [J].
Cai, Meishan ;
Zhang, Zeyu ;
Shi, Xiaojing ;
Hu, Zhenhua ;
Tian, Jie .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (06) :2213-2222
[5]   Joint L1 and total variation regularization for fluorescence molecular tomography [J].
Dutta, Joyita ;
Ahn, Sangtae ;
Li, Changqing ;
Cherry, Simon R. ;
Leahy, Richard M. .
PHYSICS IN MEDICINE AND BIOLOGY, 2012, 57 (06) :1459-1476
[6]   Noninvasive molecular imaging of c-Myc activation in living mice [J].
Fan-Minogue, Hua ;
Cao, Zhongwei ;
Paulmurugan, Ramasamy ;
Chan, Carmel T. ;
Massoud, Tarik F. ;
Felsher, Dean W. ;
Gambhir, Sanjiv S. .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2010, 107 (36) :15892-15897
[7]   Total variation regularization for nonlinear fluorescence tomography with an augmented Lagrangian splitting approach [J].
Freiberger, Manuel ;
Clason, Christian ;
Scharfetter, Hermann .
APPLIED OPTICS, 2010, 49 (19) :3741-3747
[8]   Non model-based bioluminescence tomography using a machine-learning reconstruction strategy [J].
Gao, Yuan ;
Wang, Kun ;
An, Yu ;
Jiang, Shixin ;
Meng, Hui ;
Tian, Jie .
OPTICA, 2018, 5 (11) :1451-1454
[9]   Development of a hybrid MRI and fluorescence tomography system for small animal imaging [J].
Ghijsen, Michael T. ;
Lin, Yuting ;
Nalcioglu, Orhan ;
Gulsen, Gultekin .
MULTIMODAL BIOMEDICAL IMAGING VI, 2011, 7892
[10]   3D deep encoder-decoder network for fluorescence molecular tomography [J].
Guo, Lin ;
Liu, Fei ;
Cai, Chuangjian ;
Liu, Jie ;
Zhang, Guanglei .
OPTICS LETTERS, 2019, 44 (08) :1892-1895