Robust outlier detection in geo-spatial data based on LOLIMOT and KNN search

被引:7
作者
Tabatabaei, Mohammadreza [1 ]
Kimiaefar, Roohollah [1 ,2 ]
Hajian, Alireza [1 ,2 ]
Akbari, Alireza [3 ]
机构
[1] Islamic Azad Univ, Cent Tehran Branch, Dept Phys, Tehran, Iran
[2] Islamic Azad Univ, Najafabad Branch, Dept Phys, Najafabad, Iran
[3] Islamic Azad Univ, East Tehran Branch, Dept Phys, Tehran, Iran
关键词
Outlier detection; LOLIMOT; KNN search; Zagros; Anomaly detection;
D O I
10.1007/s12145-021-00610-9
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
One of the most challenging topics in analyzing multi-dimensional geo-spatial data such as geophysical data-sets is detecting outlier data. The issue mainly originates from the difficulty in describing "normality" or "abnormality" due to the complexity of the relationships between the data elements. Considerable number of methods have been proposed and applied for detecting outliers whether they are assumed to be noise, anomalies within the data-set or simply isolated events. A new outlier detection method reached from automatic training of Local Linear Model Tree (LOLIMOT) network, and based on the data selected by K-Nearest Neighborhood (KNN) search is proposed in this research. The procedure of selecting data pairs is through decile analysis using distances calculated during KNN data grouping. Experiment on a synthetic 12 cluster 3D data-set is indicative of the method's robust performance where calculated Cumulative Error Percentage (CEP) is 13% for the method whereas the nearest value for the KNN is 19%. Also, by applying the method on a micro-gravimetric data and an earthquake catalogue related to the north Zagros- west Alborz, and based on the output of the analyses performed, the superiority of the method in outlier detection was confirmed.
引用
收藏
页码:1065 / 1072
页数:8
相关论文
共 22 条
  • [1] [Anonymous], 2001, NONLINEAR SYSTEMS ID
  • [2] The use of an outlier detecting method in time series of continuous daily measurements of underground water level and temperature in earthquake prediction investigation
    Arabelos, D
    Asteriadis, G
    Contadakis, M
    Zioutas, G
    Xu, DY
    Zhang, CD
    Zheng, BH
    [J]. TECTONOPHYSICS, 2001, 338 (3-4) : 315 - 323
  • [3] Babbar S., 2015, OUTLIER DETECTION AL
  • [4] Balta H., 2018, IFAC-PapersOnLine, V51, P348
  • [5] An Approach to Outlier Detection and Smoothing Applied to a Trajectography Radar Data
    Batista Junior, Aguinaldo Bezerra
    da Motta Pires, Paulo Sergio
    [J]. JOURNAL OF AEROSPACE TECHNOLOGY AND MANAGEMENT, 2014, 6 (03) : 237 - 248
  • [6] Dang TT, 2015, 2015 IEEE INTERNATIONAL CONFERENCE ON DIGITAL SIGNAL PROCESSING (DSP), P507, DOI 10.1109/ICDSP.2015.7251924
  • [7] Divya D, 2016, PROCEEDINGS OF 2016 INTERNATIONAL CONFERENCE ON DATA MINING AND ADVANCED COMPUTING (SAPIENCE), P23, DOI 10.1109/SAPIENCE.2016.7684114
  • [8] A comparative evaluation of outlier detection algorithms: Experiments and analyses
    Domingues, Remi
    Filippone, Maurizio
    Michiardi, Pietro
    Zouaoui, Jihane
    [J]. PATTERN RECOGNITION, 2018, 74 : 406 - 421
  • [9] An introduction to ROC analysis
    Fawcett, Tom
    [J]. PATTERN RECOGNITION LETTERS, 2006, 27 (08) : 861 - 874
  • [10] Hypocentre determination offshore of eastern Taiwan using the Maximum Intersection method
    Font, Y
    Kao, H
    Lallemand, S
    Liu, CS
    Chiao, LY
    [J]. GEOPHYSICAL JOURNAL INTERNATIONAL, 2004, 158 (02) : 655 - 675