Net-FLICS: fast quantitative wide-field fluorescence lifetime imaging with compressed sensing - a deep learning approach

被引:69
作者
Yao, Ruoyang [1 ]
Ochoa, Marien [1 ]
Yan, Pingkun [1 ]
Intes, Xavier [1 ]
机构
[1] Rensselaer Polytech Inst, Dept Biomed Engn, Troy, NY 12180 USA
基金
美国国家卫生研究院;
关键词
NETWORK;
D O I
10.1038/s41377-019-0138-x
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Macroscopic fluorescence lifetime imaging (MFLI) via compressed sensed (CS) measurements enables efficient and accurate quantification of molecular interactions in vivo over a large field of view (FOV). However, the current data-processing workflow is slow, complex and performs poorly under photon-starved conditions. In this paper, we propose Net-FLICS, a novel image reconstruction method based on a convolutional neural network (CNN), to directly reconstruct the intensity and lifetime images from raw time-resolved CS data. By carefully designing a large simulated dataset, Net-FLICS is successfully trained and achieves outstanding reconstruction performance on both in vitro and in vivo experimental data and even superior results at low photon count levels for lifetime quantification.
引用
收藏
页数:7
相关论文
共 21 条
[1]  
Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
[2]  
[Anonymous], 2017, ARXIV170205743
[3]   Deep Learning in Label-free Cell Classification [J].
Chen, Claire Lifan ;
Mahjoubfar, Ata ;
Tai, Li-Chia ;
Blaby, Ian K. ;
Huang, Allen ;
Niazi, Kayvan Reza ;
Jalali, Bahram .
SCIENTIFIC REPORTS, 2016, 6
[4]  
Cohen G, 2017, IEEE IJCNN, P2921, DOI 10.1109/IJCNN.2017.7966217
[5]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199
[6]   Compressed sensing [J].
Donoho, DL .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (04) :1289-1306
[7]   Deep Learning in Medical Imaging: Overview and Future Promise of an Exciting New Technique [J].
Greenspan, Hayit ;
van Ginneken, Bram ;
Summers, Ronald M. .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2016, 35 (05) :1153-1159
[8]   Spectrally resolved fluorescence lifetime imaging microscopy [J].
Hanley, QS ;
Arndt-Jovin, DJ ;
Jovin, TM .
APPLIED SPECTROSCOPY, 2002, 56 (02) :155-166
[9]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[10]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90