Simultaneous wavelength selection and outlier detection in multivariate regression of near-infrared spectra

被引:45
作者
Chen, D [1 ]
Shao, XG [1 ]
Hu, B [1 ]
Su, QD [1 ]
机构
[1] Univ Sci & Technol China, Dept Chem, Hefei 230026, Anhui, Peoples R China
关键词
D O I
10.2116/analsci.21.161
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Near-infrared (NIR) spectrometry will present a more promising tool for quantitative measurement if the robustness and predictive ability of the partial least square (PLS) model are improved. In order to achieve the purpose, we present a new algorithm for simultaneous wavelength selection and outlier detection; at the same time, the problems of background and noise in multivariate calibration are also solved. The strategy is a combination of continuous wavelet transform (CWT) and modified iterative predictors and objects weighting PLS (mIPOW-PLS). CWT is performed as a pretreatment tool for eliminating background and noise synchronously; then, mIPOW-PLS is proposed to remove both the useless wavelengths and the multiple outliers in CWT domain. After pretreatment with CWT-mIPOW-PLS, a PLS model is built finally for prediction. The results indicate that the combination of CWT and mIPOW-PLS produces robust and parsimonious regression models with very few wavelengths.
引用
收藏
页码:161 / 166
页数:6
相关论文
共 21 条
[1]   Elimination of uninformative variables for multivariate calibration [J].
Centner, V ;
Massart, DL ;
deNoord, OE ;
deJong, S ;
Vandeginste, BM ;
Sterna, C .
ANALYTICAL CHEMISTRY, 1996, 68 (21) :3851-3858
[2]  
Chaupart N, 1998, JOURNAL OF NEAR INFRARED SPECTROSCOPY, VOL 6 1998, P307
[3]   Variable selection by modified IPW (iterative predictor weighting)-PLS (partial least squares) in continuous wavelet regression models [J].
Chen, D ;
Hu, XG ;
Shao, XG ;
Su, QD .
ANALYST, 2004, 129 (07) :664-669
[4]   A Background and noise elimination method for quantitative calibration of near infrared spectra [J].
Chen, D ;
Shao, XG ;
Hu, B ;
Su, QD .
ANALYTICA CHIMICA ACTA, 2004, 511 (01) :37-45
[5]   Elimination of interference information by a new hybrid algorithm for quantitative calibration of near infrared spectra [J].
Chen, D ;
Wang, F ;
Shao, XG ;
Su, QD .
ANALYST, 2003, 128 (09) :1200-1203
[6]   ITERATIVELY REWEIGHTED PARTIAL LEAST-SQUARES - A PERFORMANCE ANALYSIS BY MONTE-CARLO SIMULATION [J].
CUMMINS, DJ ;
ANDREWS, CW .
JOURNAL OF CHEMOMETRICS, 1995, 9 (06) :489-507
[7]   DE-NOISING BY SOFT-THRESHOLDING [J].
DONOHO, DL .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1995, 41 (03) :613-627
[8]  
Forina M, 1999, J CHEMOMETR, V13, P165
[9]   The refinement of PLS models by iterative weighting of predictor variables and objects [J].
Forina, M ;
Casolino, C ;
Almansa, EM .
CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2003, 68 (1-2) :29-40
[10]   COMPARISON OF SEMIROBUST AND ROBUST PARTIAL LEAST-SQUARES PROCEDURES [J].
GRIEP, MI ;
WAKELING, IN ;
VANKEERBERGHEN, P ;
MASSART, DL .
CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 1995, 29 (01) :37-50