Spectral Reflectance Estimation Using Gaussian Processes and Combination Kernels

被引:26
作者
Heikkinen, Ville [1 ]
机构
[1] Univ Eastern Finland, Sch Comp, FIN-80101 Joensuu, Finland
关键词
Image reconstruction; Gaussian processes; hyperspectral imaging; color; RECONSTRUCTION; RECOVERY; MODEL;
D O I
10.1109/TIP.2018.2820839
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper explores hyperspectral reflectance factor estimation using Gaussian process regression with multispectral- and trichromatic measurements. Estimations are performed in visible-(400-700 nm) or visible-near infrared (400-980 nm) wavelength ranges using the learning-based approach, where sensor and light spectral characteristics are not required. We first construct new estimation models via Gaussian processes, show connection to previous kernel-based models, and then evaluate new models by using marginal likelihood optimization within the probabilistic interpretation. By using standard spectral ensembles and several images in experiments, we evaluate new models with anisotropic radial-and combination kernels (process covariance), marginal likelihood optimization (parameter selection), as well as with input data transformations (pre-processing). Several new Gaussian process models provide spectral accuracy improvements for simulated and real data, when compared with the previous kernel-based models. Most versatile new model is using spectral subspace coordinate learning and combination kernels, and can be efficiently optimized via marginal likelihood. Preliminary results suggest that new models provide uncertainty estimates, which can be used for iterative training set augmentation.
引用
收藏
页码:3358 / 3373
页数:16
相关论文
共 47 条
[1]   In Defense of Shallow Learned Spectral Reconstruction from RGB Images [J].
Aeschbacher, Jonas ;
Wu, Jiqing ;
Timofte, Radu .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, :471-479
[2]   Reconstruction of reflectance spectra using weighted principal component analysis [J].
Agahian, Farnaz ;
Arnirshahi, Seyed Ali ;
Amirshahi, Seyed Hossein .
COLOR RESEARCH AND APPLICATION, 2008, 33 (05) :360-371
[3]  
Alvarez-Gila A., 2017, ADVERSARIAL NETWORK
[4]   Sparse Recovery of Hyperspectral Signal from Natural RGB Images [J].
Arad, Boaz ;
Ben-Shahar, Ohad .
COMPUTER VISION - ECCV 2016, PT VII, 2016, 9911 :19-34
[5]  
Blasinski H., 2016, SIMULTANEOUS SURFACE
[6]   Characterization of trichromatic color cameras by using a new multispectral imaging technique [J].
Cheung, V ;
Westland, S ;
Li, CJ ;
Hardeberg, J ;
Connab, D .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2005, 22 (07) :1231-1240
[7]   Multi-Spectral Imaging by Optimized Wide Band Illumination [J].
Chi, Cui ;
Yoo, Hyunjin ;
Ben-Ezra, Moshe .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2010, 86 (2-3) :140-151
[8]   Improved estimation of reflectance spectra by utilizing prior knowledge [J].
Dierl, Marcel ;
Eckhard, Timo ;
Frei, Bernhard ;
Klammer, Maximilian ;
Eichstaedt, Sascha ;
Elster, Clemens .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2016, 33 (07) :1370-1376
[9]   Evaluating logarithmic kernel for spectral reflectance estimation-effects on model parametrization, training set size, and number of sensor spectral channels [J].
Eckhard, Timo ;
Valero, Eva M. ;
Hernandez-Andres, Javier ;
Heikkinen, Ville .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2014, 31 (03) :541-549
[10]   Reflectance and Fluorescence Spectral Recovery via Actively Lit RGB Images [J].
Fu, Ying ;
Lam, Antony ;
Sato, Imari ;
Okabe, Takahiro ;
Sato, Yoichi .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (07) :1313-1326