Research Progress of Single-Pixel Imaging Based on Deep Learning

被引:7
作者
Wang Qi [1 ,2 ,3 ]
Mi Jiashuai [1 ]
机构
[1] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110819, Liaoning, Peoples R China
[2] Northeastern Univ, State Key Lab Synthet Automat Proc Ind, Shenyang 110819, Liaoning, Peoples R China
[3] Hebei Key Lab Micronano Precis Opt Sensing & Meas, Qinhuangdao 066004, Hebei, Peoples R China
关键词
single pixel imaging; deep learning; computational imaging; neural network; SCATTERING MEDIA; GHOST; CLASSIFICATION; RECONSTRUCTION; MICROSCOPY; NET;
D O I
10.3788/LOP232464
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Single-pixel imaging reproduces scene images by modulating the light field to measure the intensity response of the scene with a single-pixel detector. Compared with traditional imaging techniques that rely on arrays of detectors to capture image information, single-pixel imaging excels in low-cost, broad-spectrum, and application-specific scenes. This technique is a novel imaging approach that shifts from the physical to the computational domain; hence, many studies are exploring efficient computational approaches. Owing to the powerful learning capability of neural networks in the computational domain, deep learning techniques have been extensively employed in single-pixel imaging and have made remarkable progress. In this paper, deep learning single-pixel imaging is categorized into three modes: data-driven, physical-driven, and hybrid-driven modes. Within each mode, neural networks are further categorized as "image-to-image" and "measurements-to-image" imaging methods. The basic theories and typical cases of single-pixel imaging methods based on deep learning are reviewed from six perspectives, and the advantages and shortcomings of each method are discussed. Finally, single-pixel imaging methods based on deep learning are summarized and discussed, and promising applications include hyperspectral imaging, transient observation, and target detection.
引用
收藏
页数:15
相关论文
共 93 条
[1]   On the use of deep learning for computational imaging [J].
Barbastathis, George ;
Ozcan, Aydogan ;
Situ, Guohai .
OPTICA, 2019, 6 (08) :921-943
[2]   Two-photon coincidence imaging with a classical source [J].
Bennink, RS ;
Bentley, SJ ;
Boyd, RW .
PHYSICAL REVIEW LETTERS, 2002, 89 (11)
[3]   Image-free multi-character recognition [J].
Bian, Liheng ;
Wang, Huayi ;
Zhu, Chunli ;
Zhang, Jun .
OPTICS LETTERS, 2022, 47 (06) :1343-1346
[4]   A residual-based deep learning approach for ghost imaging [J].
Bian, Tong ;
Yi, Yuxuan ;
Hu, Jiale ;
Zhang, Yin ;
Wang, Yide ;
Gao, Lu .
SCIENTIFIC REPORTS, 2020, 10 (01)
[5]  
Brock A, 2019, Arxiv, DOI arXiv:1809.11096
[6]   Single-pixel pattern recognition with coherent nonlinear optics [J].
Bu, Ting ;
Kumar, Santosh ;
Zhang, He ;
Huang, Irwin ;
Huang, Yu-Ping .
OPTICS LETTERS, 2020, 45 (24) :6771-6774
[7]   Single-pixel neural network object classification of sub-Nyquist ghost imaging [J].
Cao, Jia-Ning ;
Zuo, Yu-Hui ;
Wang, Hua-Hua ;
Feng, Wei-Dong ;
Yang, Zhi-Xin ;
Ma, Jian ;
Du, Hao-Ran ;
Gao, Lu ;
Zhang, Ze .
APPLIED OPTICS, 2021, 60 (29) :9180-9187
[8]   Self-supervised learning for single-pixel imaging via dual-domain constraints [J].
Chang, Xuyang ;
Wu, Ze ;
LI, Daoyu ;
Zhan, Xinrui ;
Yan, Rong ;
Bian, Liheng .
OPTICS LETTERS, 2023, 48 (07) :1566-1569
[9]   High-efficiency terahertz single-pixel imaging based on a physics-enhanced network [J].
Deng, Youquan ;
She, Rongbin ;
Liu, Wenquan ;
Lu, Yuanfu ;
Li, Guangyuan .
OPTICS EXPRESS, 2023, 31 (06) :10273-10286
[10]   Compressed sensing [J].
Donoho, DL .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (04) :1289-1306