Research Progress of Single-Pixel Imaging Based on Deep Learning

被引:7
作者
Wang Qi [1 ,2 ,3 ]
Mi Jiashuai [1 ]
机构
[1] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110819, Liaoning, Peoples R China
[2] Northeastern Univ, State Key Lab Synthet Automat Proc Ind, Shenyang 110819, Liaoning, Peoples R China
[3] Hebei Key Lab Micronano Precis Opt Sensing & Meas, Qinhuangdao 066004, Hebei, Peoples R China
关键词
single pixel imaging; deep learning; computational imaging; neural network; SCATTERING MEDIA; GHOST; CLASSIFICATION; RECONSTRUCTION; MICROSCOPY; NET;
D O I
10.3788/LOP232464
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Single-pixel imaging reproduces scene images by modulating the light field to measure the intensity response of the scene with a single-pixel detector. Compared with traditional imaging techniques that rely on arrays of detectors to capture image information, single-pixel imaging excels in low-cost, broad-spectrum, and application-specific scenes. This technique is a novel imaging approach that shifts from the physical to the computational domain; hence, many studies are exploring efficient computational approaches. Owing to the powerful learning capability of neural networks in the computational domain, deep learning techniques have been extensively employed in single-pixel imaging and have made remarkable progress. In this paper, deep learning single-pixel imaging is categorized into three modes: data-driven, physical-driven, and hybrid-driven modes. Within each mode, neural networks are further categorized as "image-to-image" and "measurements-to-image" imaging methods. The basic theories and typical cases of single-pixel imaging methods based on deep learning are reviewed from six perspectives, and the advantages and shortcomings of each method are discussed. Finally, single-pixel imaging methods based on deep learning are summarized and discussed, and promising applications include hyperspectral imaging, transient observation, and target detection.
引用
收藏
页数:15
相关论文
共 93 条
[61]   Local-enhanced transformer for single-pixel imaging [J].
Tian, Ye ;
Fu, Ying ;
Zhang, Jun .
OPTICS LETTERS, 2023, 48 (10) :2635-2638
[62]   Joint supervised and unsupervised deep learning method for single-pixel imaging [J].
Tian, Ye ;
Fu, Ying ;
Zhang, Jun .
OPTICS AND LASER TECHNOLOGY, 2023, 162
[63]   Deep Image Prior [J].
Ulyanov, Dmitry ;
Vedaldi, Andrea ;
Lempitsky, Victor .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :9446-9454
[64]   Two-photon imaging with thermal light [J].
Valencia, A ;
Scarcelli, G ;
D'Angelo, M ;
Shih, Y .
PHYSICAL REVIEW LETTERS, 2005, 94 (06)
[65]  
Van Veen D, 2020, Arxiv, DOI arXiv:1806.06438
[66]   Single-Pixel Hyperspectral Imaging via an Untrained Convolutional Neural Network [J].
Wang, Chen-Hui ;
Li, Hong-Ze ;
Bie, Shu-Hang ;
Lv, Rui-Bing ;
Chen, Xi-Hao .
PHOTONICS, 2023, 10 (02)
[67]   Far-field super-resolution ghost imaging with a deep neural network constraint [J].
Wang, Fei ;
Wang, Chenglong ;
Chen, Mingliang ;
Gong, Wenlin ;
Zhang, Yu ;
Han, Shensheng ;
Situ, Guohai .
LIGHT-SCIENCE & APPLICATIONS, 2022, 11 (01)
[68]   Single-pixel imaging using physics enhanced deep learning [J].
Wang, Fei ;
Wang, Chenglong ;
Deng, Chenjin ;
Han, Shensheng ;
Situ, Guohai .
PHOTONICS RESEARCH, 2022, 10 (01) :104-110
[69]   Phase imaging with an untrained neural network [J].
Wang, Fei ;
Bian, Yaoming ;
Wang, Haichao ;
Lyu, Meng ;
Pedrini, Giancarlo ;
Osten, Wolfgang ;
Barbastathis, George ;
Situ, Guohai .
LIGHT-SCIENCE & APPLICATIONS, 2020, 9 (01)
[70]   Learning from simulation: An end-to-end deep-learning approach for computational ghost imaging [J].
Wang, Fei ;
Wang, Hao ;
Wang, Haichao ;
Li, Guowei ;
Situ, Guohai .
OPTICS EXPRESS, 2019, 27 (18) :25560-25572