Compressive spectral imaging with color-coded illumination

被引:0
|
作者
Zhang, Hao [1 ,2 ]
Zhao, Xianhong [3 ]
Liu, Yusen [1 ,2 ]
Shi, Xueliang [4 ]
Zhou, Siyuan [5 ]
Chen, Yuwei [2 ,6 ]
机构
[1] Natl Univ Def Technol, State Key Lab Pulsed Power Laser Technol, Hefei 230037, Peoples R China
[2] Adv Laser Technol Lab Anhui Prov, Hefei 230000, Peoples R China
[3] Chinese Univ Hong Kong, Sch Sci & Engn, Shenzhen CUHK Shenzhen, Shenzhen 518172, Guangdong, Peoples R China
[4] Jiangxi Opt Lens Prod Qual Supervis & Inspect Ctr, Shangrao 334100, Peoples R China
[5] North Informat Control Res Acad Grp Co Ltd, Nanjing 211153, Peoples R China
[6] Univ Chinese Acad Sci, Hangzhou Inst Adv Study, Hangzhou 310024, Peoples R China
来源
OPTICS AND LASER TECHNOLOGY | 2025年 / 184卷
关键词
Compressive spectral imaging; Computational imaging; Color-coded illumination; Deep learning; End-to-end optimization; APERTURE DESIGN; ALGORITHMS;
D O I
10.1016/j.optlastec.2025.112446
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Compressive spectral imaging has emerged as a sensing tool where three-dimensional (3D) data can be obtained using two-dimensional (2D) projection measurements. The 3D data cube is reconstructed computationally. However, compressive spectral imagers suffer from system complexity, sophisticated calibration and expensive hardware, which impedes its wide applications. In this work, we propose a simple and low-budget color-coded illumination compressive spectral imaging system (CCISI), that allows for the acquisition of spectral images from a single exposure. CCISI employs color-coded illumination strategy to modulate the spatial and spectral information of the target simultaneously. A grayscale detector then captures the encoded scattered light from the target. To reconstruct the 3D spectral data cube from the single encoded compressive measurement, we propose a regularized end-to-end deep-learning-based architecture, where a set of layers of the deep neural network models the color-coded pattern and the spectrum curves of color-coded illuminations are optimized in the end-to-end network. In contrast, the rest of the network performs the reconstruction task. The effectiveness and accuracy of the proposed CCISI system are verified on both synthetic and real captured images. Extensive experiments show that our method significantly outperforms state-of-the-art (SOTA) methods.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Snapshot Compressive ToF plus Spectral Imaging via Optimized Color-Coded Apertures
    Rueda-Chacon, Hoover
    Florez-Ospina, Juan F.
    Lau, Daniel L.
    Arce, Gonzalo R.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (10) : 2346 - 2360
  • [2] Shift-variant color-coded diffractive spectral imaging system
    Arguello, Henry
    Pinilla, Samuel
    Peng, Yifan
    Ikoma, Hayato
    Bacca, Jorge
    Wetzstein, Gordon
    OPTICA, 2021, 8 (11): : 1424 - 1434
  • [3] Optimization of color-coded apertures for compressive multispectral and depth imaging with time-of-flight sensors
    Rueda-Chacon, Hoover
    Arce, Gonzalo R.
    DIMENSIONAL OPTICAL METROLOGY AND INSPECTION FOR PRACTICAL APPLICATIONS XIII, 2024, 13038
  • [4] Coded Aperture Optimization in Spatial Spectral Compressive Spectral Imagers
    Salazar, Edgar
    Arce, Gonzalo R.
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2020, 6 : 764 - 777
  • [5] Grating-based coded aperture compressive spectral imaging to reconstruct over 190 spectral bands from a snapshot measurement
    Luo, Ting
    Wang, Lishun
    Yuan, Xin
    JOURNAL OF PHYSICS D-APPLIED PHYSICS, 2023, 56 (25)
  • [6] Snapshot compressive spectral imaging based on adaptive coded apertures
    Ma, Xu
    Zhang, Hao
    Ma, Xiao
    Arce, Gonzalo R.
    Xu, Tingfa
    Mao, Tianyi
    COMPRESSIVE SENSING VII: FROM DIVERSE MODALITIES TO BIG DATA ANALYTICS, 2018, 10658
  • [7] Learned Multi-aperture Color-coded Optics for Snapshot Hyperspectral Imaging
    Shi, Zheng
    Dun, Xiong
    Wei, Haoyu
    Dong, Shiyu
    Wang, Zhanshan
    Cheng, Xinbin
    Heide, Felix
    Peng, Yifan
    ACM TRANSACTIONS ON GRAPHICS, 2024, 43 (06):
  • [8] HIGH-DIMENSIONAL OPTIMIZATION OF COLOR CODED APERTURES FOR COMPRESSIVE SPECTRAL CAMERAS
    Rueda, Hoover
    Arguello, Henry
    Arce, Gonzalo R.
    2017 25TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2017, : 463 - 467
  • [9] Spatio-Spectral Uniform Multi-Frame Coded Apertures for Compressive Spectral Imaging
    Correa, Claudia V.
    Arguello, Henry
    Arce, Gonzalo R.
    2015 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2015, : 614 - 618
  • [10] Color-coded LED microscopy for quantitative phase imaging: Implementation and application to sperm motility analysis
    Lee, Wonchan
    Choi, Jun-Ho
    Ryu, Suho
    Jung, Daeseong
    Song, Jaewoo
    Lee, Jong-Seok
    Joo, Chulmin
    METHODS, 2018, 136 : 66 - 74