Trends in Snapshot Spectral Imaging: Systems, Processing, and Quality

被引:2
作者
Thomas, Jean-Baptiste [1 ,2 ]
Lapray, Pierre-Jean [3 ]
Le Moan, Steven [2 ]
机构
[1] Univ Bourgogne Europe, Dept Informat Elect Mecan IEM, Imagerie & Vis Artificielle ImVIA Lab, F-21000 Dijon, France
[2] NTNU Norwegian Univ Sci & Technol, Dept Comp Sci, N-2815 Gjovik, Norway
[3] Univ Haute Alsace, Inst Res Comp Sci Math Automat & Signal, IRIMAS UR 7499, F-68100 Mulhouse, Alsace, France
关键词
spectral imaging; snapshot spectral imaging; image reconstruction; image quality; DYNAMIC-RANGE; FILTER; COLOR; DEMOSAICKING; RESOLUTION; IMAGES; REPRESENTATION; ACQUISITION; SURFACE; DESIGN;
D O I
10.3390/s25030675
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Recent advances in spectral imaging have enabled snapshot acquisition, as a means to mitigate the impracticalities of spectral imaging, e.g., expert operators and cumbersome hardware. Snapshot spectral imaging, e.g., in technologies like spectral filter arrays, has also enabled higher temporal resolution at the expense of the spatio-spectral resolution, allowing for the observation of temporal events. Designing, realising, and deploying such technologies is yet challenging, particularly due to the lack of clear, user-meaningful quality criteria across diverse applications, sensor types, and workflows. Key research gaps include optimising raw image processing from snapshot spectral imagers and assessing spectral image and video quality in ways valuable to end-users, manufacturers, and developers. This paper identifies several challenges and current opportunities. It proposes considering them jointly and suggests creating a new unified snapshot spectral imaging paradigm that would combine new systems and standards, new algorithms, new cost functions, and quality indices.
引用
收藏
页数:22
相关论文
共 176 条
[1]   A Global Quality Measurement of Pan-Sharpened Multispectral Imagery [J].
Alparone, Luciano ;
Baronti, Stefano ;
Garzelli, Andrea ;
Nencini, Filippo .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2004, 1 (04) :313-317
[2]   N-LMMSE Demosaicing for Spectral Filter Arrays [J].
Amba, Prakhar ;
Thomas, Jean Baptiste ;
Alleysson, David .
JOURNAL OF IMAGING SCIENCE AND TECHNOLOGY, 2017, 61 (04)
[3]  
[Anonymous], 2018, Sony Polarization Image Sensor
[4]  
[Anonymous], 2009, PhotographyElectronic Still-Picture CamerasMethods for Measuring Opto-Electronic Conversion Functions (OECFs)
[5]  
[Anonymous], 2024, ISO 12233:2024
[6]  
Anuta Paul E., 1970, IEEE Trans. Geosci. Electron, V8, P353, DOI 10.1109/TGE.1970.271435
[7]   NTIRE 2022 Spectral Recovery Challenge and Data Set [J].
Arad, Boaz ;
Timofte, Radu ;
Yahel, Rony ;
Morag, Nimrod ;
Bernat, Amir ;
Cai, Yuanhao ;
Lin, Jing ;
Lin, Zudi ;
Wang, Haoqian ;
Zhang, Yulun ;
Pfister, Hanspeter ;
Van Gool, Luc ;
Liu, Shuai ;
Li, Yongqiang ;
Feng, Chaoyu ;
Lei, Lei ;
Li, Jiaojiao ;
Du, Songcheng ;
Wu, Chaoxiong ;
Leng, Yihong ;
Song, Rui ;
Zhang, Mingwei ;
Song, Chongxing ;
Zhao, Shuyi ;
Lang, Zhiqiang ;
Wei, Wei ;
Zhang, Lei ;
Dian, Renwei ;
Shan, Tianci ;
Guo, Anjing ;
Feng, Chengguo ;
Liu, Jinyang ;
Agarla, Mirko ;
Bianco, Simone ;
Buzzelli, Marco ;
Celona, Luigi ;
Schettini, Raimondo ;
He, Jiang ;
Xiao, Yi ;
Xiao, Jiajun ;
Yuan, Qiangqiang ;
Li, Jie ;
Zhang, Liangpei ;
Kwon, Taesung ;
Ryu, Dohoon ;
Bae, Hyokyoung ;
Yang, Hao-Hsiang ;
Chang, Hua-En ;
Huang, Zhi-Kai ;
Chen, Wei-Ting .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, :862-880
[8]   Compressive Coded Aperture Spectral Imaging [J].
Arce, Gonzalo R. ;
Brady, David J. ;
Carin, Lawrence ;
Arguello, Henry ;
Kittle, David S. .
IEEE SIGNAL PROCESSING MAGAZINE, 2014, 31 (01) :105-115
[9]   Computational spectral imaging: a contemporary overview [J].
Bacca, Jorge ;
Martinez, Emmanuel ;
Arguello, Henry .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2023, 40 (04) :C115-C125
[10]   Multimodal spatio-temporal-spectral fusion for deep learning applications in physiological time series processing: A case study in monitoring the depth of anesthesia [J].
Bahador, Nooshin ;
Jokelainen, Jarno ;
Mustola, Seppo ;
Kortelainen, Jukka .
INFORMATION FUSION, 2021, 73 :125-143