Online Detecting Water Quality Anomaly from UV/Vis Spectra Using Baseline Correction and Principal Component Analysis Method

被引:6
作者
Guo Bing-bing [1 ]
Hou Di-bo [1 ]
Jin Yu [1 ]
Yin Hang [1 ]
Huang Ping-jie [1 ]
Zhang Guang-xin [1 ]
Zhang Hong-jian [1 ]
机构
[1] Zhejiang Univ, State Key Lab Ind Control Technol, Coll Control Sci & Engn, Hangzhou 310027, Zhejiang, Peoples R China
关键词
UV/Vis spectrum; Water quality anomaly detection; Asymmetric least squares; Principal component analysis; Q statistic; EVENT DETECTION; WASTE-WATER;
D O I
10.3964/j.issn.1000-0593(2017)05-1460-06
中图分类号
O433 [光谱学];
学科分类号
0703 ; 070302 ;
摘要
In recent years, water quality security issue has aroused widespread social concerns. Ultraviolet and visible absorption spectrum for real-time monitoring of water quality has the advantages of in-situ detection as well as no need for reagents and rapid analysis, which makes it suitable for online detection. However, the ultraviolet and visible spectra are of large size and easily interfered by instrument and the normal water quality fluctuation, which affect the water quality anomaly detection result. In this paper, the baseline correction and principal component analysis method for UV/Vis spectra is proposed to detect abnormal water quality. The asymmetric least squares algorithm is used to correct the baseline and the principal component analysis for UV/Vis spectral matrix is adopted to reduce dimensions and extract features. Afterwards the outliers in the test samples are evaluated according to the Q statistic in the residual subspace. Finally, anomalies warning is updated by calculating the cumulative probability. The performance of the proposed method is evaluated by using data from phenol injection experiments. Results show that the proposed method effectively improves the detection limit of pollutants and has a higher detection rate and lower false alarm rate compared with the result without baseline correction.
引用
收藏
页码:1460 / 1465
页数:6
相关论文
共 16 条
[1]  
Arad J, 2012, ASCE, P2903
[2]  
Byer D, 2005, J AM WATER WORKS ASS, V97, P130
[3]  
Chiang LeoH., 2001, Springer Science Business Media
[4]  
CHU Xiao-li, 2011, MOL SPECTROSCOPY ANA, P54
[5]   Identification of industrial wastewater by clustering wastewater treatment plant influent ultraviolet visible spectra [J].
Duerrenmatt, David J. ;
Gujer, Willi .
WATER SCIENCE AND TECHNOLOGY, 2011, 63 (06) :1153-1159
[6]  
Eilers P., 2005, LEIDEN U MEDICAL CTR
[7]  
Hasan J., 2004, J. Contemp. Water Res. Educ, V129, P27, DOI [10.1111/j.1936-704X.2004.mp129001007.x, DOI 10.1111/j.1936-704X.2004.mp129001007.x]
[8]  
HE Hui-mei, 2013, J ZHEJIANG U, V4, P26
[9]   Distribution water quality anomaly detection from UV optical sensor monitoring data by integrating principal component analysis with chi-square distribution [J].
Hou, Dibo ;
Zhang, Jian ;
Yang, Zheling ;
Liu, Shu ;
Huang, Pingjie ;
Zhang, Guangxin .
OPTICS EXPRESS, 2015, 23 (13) :17487-17510
[10]   Online Monitoring of Water-Quality Anomaly in Water Distribution Systems Based on Probabilistic Principal Component Analysis by UV-Vis Absorption Spectroscopy [J].
Hou, Dibo ;
Liu, Shu ;
Zhang, Jian ;
Chen, Fang ;
Huang, Pingjie ;
Zhang, Guangxin .
JOURNAL OF SPECTROSCOPY, 2014, 2014