SP-ILC: Concurrent Single-Pixel Imaging, Object Location, and Classification by Deep Learning

被引:10
|
作者
Yang, Zhe [1 ,2 ]
Bai, Yu-Ming [1 ,2 ]
Sun, Li-Da [1 ,2 ]
Huang, Ke-Xin [1 ,2 ]
Liu, Jun [3 ]
Ruan, Dong [1 ,2 ,4 ]
Li, Jun-Lin [1 ,2 ]
机构
[1] Tsinghua Univ, State Key Lab Low Dimens Quantum Phys, Beijing 100084, Peoples R China
[2] Tsinghua Univ, Dept Phys, Beijing 100084, Peoples R China
[3] Wuhan Digital Engn Inst, Wuhan 430074, Peoples R China
[4] Frontier Sci Ctr Quantum Informat, Beijing 100084, Peoples R China
基金
中国国家自然科学基金;
关键词
single-pixel imaging; object location; object classification; multitask learning; deep learning; GHOST; RECONSTRUCTION; ILLUMINATION; RECALL;
D O I
10.3390/photonics8090400
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
We propose a concurrent single-pixel imaging, object location, and classification scheme based on deep learning (SP-ILC). We used multitask learning, developed a new loss function, and created a dataset suitable for this project. The dataset consists of scenes that contain different numbers of possibly overlapping objects of various sizes. The results we obtained show that SP-ILC runs concurrent processes to locate objects in a scene with a high degree of precision in order to produce high quality single-pixel images of the objects, and to accurately classify objects, all with a low sampling rate. SP-ILC has potential for effective use in remote sensing, medical diagnosis and treatment, security, and autonomous vehicle control.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] Single-pixel imaging for a high-speed rotating object with varying rotation speed
    Yao, Manhong
    Yang, Ganhong
    Yin, Jun
    Zhang, Zibang
    Zhong, Jingang
    OPTICS AND LASER TECHNOLOGY, 2024, 177
  • [32] Single-pixel non-imaging object recognition by means of Fourier spectrum acquisition
    Chen, Huichao
    Shi, Jianhong
    Liu, Xialin
    Niu, Zhouzhou
    Zeng, Guihua
    OPTICS COMMUNICATIONS, 2018, 413 : 269 - 275
  • [33] 3D Single-pixel imaging with active sampling patterns and learning based reconstruction
    Ma, Xinyue
    Wang, Chenxing
    OPTICS AND LASERS IN ENGINEERING, 2023, 163
  • [34] COMPRESSIVE CLASSIFICATION FROM SINGLE PIXEL MEASUREMENTS VIA DEEP LEARNING
    Bacca, Jorge
    Correa, Claudia, V
    Vargas, Edwin
    Castillo, Sergio
    Arguello, Henry
    2019 IEEE 29TH INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2019,
  • [35] Complex object wave retrieval using single-pixel compressive imaging of an off-axis Fresnel hologram
    Reddy, B. Lokesh
    Nelleri, Anith
    JOURNAL OF MODERN OPTICS, 2022, 69 (10) : 541 - 553
  • [36] Image Denoising via Adaptive Dictionary Learning Based on Single-Pixel Imaging
    Wei, Ziran
    Zhang, Jianlin
    Xu, Zhiyong
    Liu, Yong
    AOPC 2020: OPTICAL SENSING AND IMAGING TECHNOLOGY, 2020, 11567
  • [37] Camera Geometric Calibration Using Dynamic Single-Pixel Illumination With Deep Learning Networks
    Li, Jin
    Liu, Zilong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (08) : 2550 - 2558
  • [38] Non-line-of-sight transparent object detection and reconstruction based on passive single-pixel imaging
    Li, Mengdi
    Mathai, Anumol
    Xu, Xiping
    Wang, Xin
    Pan, Yue
    Gao, Xuefeng
    LASER PHYSICS LETTERS, 2021, 18 (02)
  • [39] Deep Learning Integrated with Multiscale Pixel and Object Features for Hyperspectral Image Classification
    Zhang, Meng
    Hong, Liang
    2018 10TH IAPR WORKSHOP ON PATTERN RECOGNITION IN REMOTE SENSING (PRRS), 2018,
  • [40] High-quality object reconstruction based on single-pixel imaging in highly dynamic scattering environments
    Xiao, Yin
    Chen, Wen
    INTERNATIONAL CONFERENCE ON OPTICAL AND PHOTONIC ENGINEERING, ICOPEN 2023, 2024, 13069