An outlier detection and recovery method based on moving least squares quasi-interpolation scheme and l0-minimization problem

被引:2
作者
Zheng, Sanpeng [1 ]
Feng, Renzhong [1 ]
Huang, Aitong [1 ]
机构
[1] Beihang Univ, Sch Math Sci, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Scattered data; Outlier detection; Moving least squares; Quasi-interpolation; l0-Minimization problem; APPROXIMATION;
D O I
10.1016/j.apm.2023.05.032
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
In the scattered data used for function approximation, there may be some data that de-viate greatly from their true values, which are called outliers. The existence of outliers significantly affects the accuracy of some approximation methods, such as moving least squares. How to quickly and accurately find these outliers and restore their true values has not been well resolved. In this paper, a new outlier detection and recovery method is proposed for data processing. The method uses the high accuracy of moving least squares quasi-interpolation scheme, its sensitivity to outliers and the sparse distribution of out-liers to construct a l0-minimization problem with an inequality constrain. Under certain assumptions, it is proved theoretically that the deviation vector corresponding to the out-liers is a solution to the optimization problem. The classical orthogonal matching pursuit algorithm is introduced to solve the optimization problem efficiently. By solving the prob-lem, the outliers are marked, and the deviations are also estimated approximately, which can restore the true values of outliers. The numerical experiments demonstrate that the proposed method has high computational efficiency, very high detection accuracy, and high recovery accuracy for the scattered data used for function approximation, so it is practical. & COPY; 2023 Elsevier Inc. All rights reserved.
引用
收藏
页码:127 / 150
页数:24
相关论文
共 25 条
[1]   Quasi-interpolation and outliers removal [J].
Amir, Anat ;
Levin, David .
NUMERICAL ALGORITHMS, 2018, 78 (03) :805-825
[2]  
Boukerche A, 2020, ACM COMPUT SURV, V53, DOI [10.1145/3381028, 10.1145/3421763]
[3]   Interpolating stabilized moving least squares (MLS) approximation for 2D elliptic interface problems [J].
Dehghan, Mehdi ;
Abbaszadeh, Mostafa .
COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING, 2018, 328 :775-803
[4]   Least absolute value regression: recent contributions [J].
Dielman, TE .
JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2005, 75 (04) :263-286
[5]  
Du HZ, 2016, IEEE CONF COMPUT, DOI 10.1109/INFCOMW.2016.7562187
[6]  
Fasshauer G.E., 2007, Interdisciplinary Mathematical Sciences, V6
[7]  
Halton J.H., 1960, NUMER MATH, V2, P84
[8]   A survey of outlier detection methodologies [J].
Hodge V.J. ;
Austin J. .
Artificial Intelligence Review, 2004, 22 (2) :85-126
[9]   The approximation power of moving least-squares [J].
Levin, D .
MATHEMATICS OF COMPUTATION, 1998, 67 (224) :1517-1531
[10]  
Levin D, 2015, BIT, V55, P781, DOI 10.1007/s10543-014-0522-0