Spectral denoising based on Hilbert-Huang transform combined with F-test

被引:11
作者
Bian, Xihui [1 ,2 ,3 ]
Ling, Mengxuan [1 ,2 ,3 ]
Chu, Yuanyuan [1 ]
Liu, Peng [1 ]
Tan, Xiaoyao [1 ]
机构
[1] Tiangong Univ, Sch Chem Engn & Technol, Key Lab Separat Membranes & Membrane Proc, Tianjin, Peoples R China
[2] Yibin Univ, Sichuan Univ, Key Lab Proc Anal & Control, Yibin, Sichuan, Peoples R China
[3] Qinghai Univ, State Key Lab Plateau Ecol & Agr, Xining, Peoples R China
来源
FRONTIERS IN CHEMISTRY | 2022年 / 10卷
关键词
denoising; Hilbert-Huang transform; empirical mode decomposition; x-ray diffraction; x-ray photoelectron spectrum; f-test; EMPIRICAL MODE DECOMPOSITION; IDENTIFICATION; SPECTROSCOPY; SAMPLES;
D O I
10.3389/fchem.2022.949461
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Due to the influence of uncontrollable factors such as the environment and instruments, noise is unavoidable in a spectral signal, which may affect the spectral resolution and analysis result. In the present work, a novel spectral denoising method is developed based on the Hilbert-Huang transform (HHT) and F-test. In this approach, the original spectral signal is first decomposed by empirical mode decomposition (EMD). A series of intrinsic mode functions (IMFs) and a residual (r) are obtained. Then, the Hilbert transform (HT) is performed on each IMF and r to calculate their instantaneous frequencies. The mean and standard deviation of instantaneous frequencies are calculated to further illustrate the IMF frequency information. Third, the F-test is used to determine the cut-off point between noise frequency components and non-noise ones. Finally, the denoising signal is reconstructed by adding the IMF components after the cut-off point. Artificially chemical noised signal, X-ray diffraction (XRD) spectrum, and X-ray photoelectron spectrum (XPS) are used to validate the performance of the method in terms of the signal-to-noise ratio (SNR). The results show that the method provides superior denoising capabilities compared with Savitzky-Golay (SG) smoothing.
引用
收藏
页数:9
相关论文
共 34 条
[1]   Authentication of Sorrento Walnuts by NIR Spectroscopy Coupled with Different Chemometric Classification Strategies [J].
Amendola, Luigi ;
Firmani, Patrizia ;
Bucci, Remo ;
Marini, Federico ;
Biancolillo, Alessandra .
APPLIED SCIENCES-BASEL, 2020, 10 (11)
[2]  
Bian X., 2022, Chemometric Methods in Analytical Spectroscopy Technology, P111, DOI [10.1007/978-981-19-1625-04, DOI 10.1007/978-981-19-1625-04]
[3]   Rapid identification of milk samples by high and low frequency unfolded partial least squares discriminant analysis combined with near-infrared spectroscopy [J].
Bian, Xihui ;
Zhang, Caixia ;
Liu, Peng ;
Wei, Junfu ;
Tan, Xiaoyao ;
Lin, Ligang ;
Chang, Na ;
Guo, Yugao .
CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2017, 170 :96-101
[4]   High and low frequency unfolded partial least squares regression based on empirical mode decomposition for quantitative analysis of fuel oil samples [J].
Bian, Xihui ;
Li, Shujuan ;
Lin, Ligang ;
Tan, Xiaoyao ;
Fan, Qingjie ;
Li, Ming .
ANALYTICA CHIMICA ACTA, 2016, 925 :16-22
[5]   Rapid Determination of Metabolites in Bio-fluid Samples by Raman Spectroscopy and Optimum Combinations of Chemometric Methods [J].
Bian Xihui ;
Chen Da ;
Cai Wensheng ;
Grant, Edward ;
Shao Xueguang .
CHINESE JOURNAL OF CHEMISTRY, 2011, 29 (11) :2525-2532
[6]   A Background and noise elimination method for quantitative calibration of near infrared spectra [J].
Chen, D ;
Shao, XG ;
Hu, B ;
Su, QD .
ANALYTICA CHIMICA ACTA, 2004, 511 (01) :37-45
[7]   Adaptive wavelet transform suppresses background and noise for quantitative analysis by Raman spectrometry [J].
Chen, Da ;
Chen, Zhiwen ;
Grant, Edward .
ANALYTICAL AND BIOANALYTICAL CHEMISTRY, 2011, 400 (02) :625-634
[8]   Voice Disorder Identification by using Hilbert-Huang Transform (HHT) and K Nearest Neighbor (KNN) [J].
Chen, Lili ;
Wang, Chaoyu ;
Chen, Junjiang ;
Xiang, Zejun ;
Hu, Xue .
JOURNAL OF VOICE, 2021, 35 (06) :932.e1-932.e11
[9]   Empirical Low-Rank Approximation for Seismic Noise Attenuation [J].
Chen, Yangkang ;
Zhou, Yatong ;
Chen, Wei ;
Zu, Shaohuan ;
Huang, Weilin ;
Zhang, Dong .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2017, 55 (08) :4696-4711
[10]   A facile method to synthesize 3D nanosheets of Fe/S doped α-Ni(OH)2 as an electrocatalyst for improved oxygen evolution reaction [J].
Chu, Yuanyuan ;
Zhang, Xiaoxiao ;
Deng, Bohan ;
Wang, Kuixiao ;
Tan, Xiaoyao .
NANOTECHNOLOGY, 2022, 33 (40)