Nearest-Neighbor Guided Evaluation of Data Reliability and Its Applications

被引:54
|
作者
Boongoen, Tossapon [1 ]
Shen, Qiang [1 ]
机构
[1] Aberystwyth Univ, Dept Comp Sci, Aberystwyth SY23 3DB, Dyfed, Wales
来源
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS | 2010年 / 40卷 / 06期
基金
英国工程与自然科学研究理事会;
关键词
Alias detection; data reliability; nearest neighbor; ordered weighted averaging (OWA) aggregation; unsupervised feature selection; weight determination; FEATURE-SELECTION; DIMENSIONALITY REDUCTION; CONSENSUS; ALGORITHMS; SEARCH;
D O I
10.1109/TSMCB.2010.2043357
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The intuition of data reliability has recently been incorporated into the main stream of research on ordered weighted averaging (OWA) operators. Instead of relying on human-guided variables, the aggregation behavior is determined in accordance with the underlying characteristics of the data being aggregated. Data-oriented operators such as the dependent OWA (DOWA) utilize centralized data structures to generate reliable weights, however. Despite their simplicity, the approach taken by these operators neglects entirely any local data structure that represents a strong agreement or consensus. To address this issue, the cluster-based OWA (Clus-DOWA) operator has been proposed. It employs a cluster-based reliability measure that is effective to differentiate the accountability of different input arguments. Yet, its actual application is constrained by the high computational requirement. This paper presents a more efficient nearest-neighbor-based reliability assessment for which an expensive clustering process is not required. The proposed measure can be perceived as a stress function, from which the OWA weights and associated decision-support explanations can be generated. To illustrate the potential of this measure, it is applied to both the problem of information aggregation for alias detection and the problem of unsupervised feature selection (in which unreliable features are excluded from an actual learning process). Experimental results demonstrate that these techniques usually outperform their conventional state-of-the-art counterparts.
引用
收藏
页码:1622 / 1633
页数:12
相关论文
共 50 条
  • [1] EVALUATION OF PROCEDURES UTILIZED IN NEAREST-NEIGHBOR ANALYSIS
    INGRAM, DR
    GEOGRAFISKA ANNALER SERIES B-HUMAN GEOGRAPHY, 1978, 60 (01) : 65 - 70
  • [2] Efficient Nearest-Neighbor Data Sharing in GPUs
    Nematollahi, Negin
    Sadrosadati, Mohammad
    Falahati, Hajar
    Barkhordar, Marzieh
    Drumond, Mario Paulo
    Sarbazi-Azad, Hamid
    Falsafi, Babak
    ACM TRANSACTIONS ON ARCHITECTURE AND CODE OPTIMIZATION, 2021, 18 (01)
  • [3] Data Acquisition for Probabilistic Nearest-Neighbor Query
    Lin, Yu-Chieh
    Yang, De-Nian
    Shuai, Hong-Han
    Chen, Ming-Syan
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2015, 27 (02) : 410 - 427
  • [4] ON NEAREST-NEIGHBOR GRAPHS
    PATERSON, MS
    YAO, FF
    LECTURE NOTES IN COMPUTER SCIENCE, 1992, 623 : 416 - 426
  • [5] On Nearest-Neighbor Graphs
    D. Eppstein
    M. S. Paterson
    F. F. Yao
    Discrete & Computational Geometry, 1997, 17 : 263 - 282
  • [6] AN EVALUATION OF NEAREST-NEIGHBOR METHODS FOR TAG REFINEMENT
    Uricchio, Tiberio
    Ballan, Lamberto
    Bertini, Marco
    Del Bimbo, Alberto
    2013 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME 2013), 2013,
  • [7] Nearest-neighbor methods
    Sutton, Clifton
    WILEY INTERDISCIPLINARY REVIEWS-COMPUTATIONAL STATISTICS, 2012, 4 (03): : 307 - 309
  • [8] On nearest-neighbor graphs
    Eppstein, D
    Paterson, MS
    Yao, FF
    DISCRETE & COMPUTATIONAL GEOMETRY, 1997, 17 (03) : 263 - 282
  • [9] EVALUATION OF POTENTIOMETRIC DATA OF WEAK POLYELECTROLYTES TAKING ACCOUNT OF NEAREST-NEIGHBOR INTERACTION
    BLOYSVANTRESLONG, CJ
    RECUEIL DES TRAVAUX CHIMIQUES DES PAYS-BAS-JOURNAL OF THE ROYAL NETHERLANDS CHEMICAL SOCIETY, 1978, 97 (01): : 13 - 21
  • [10] ANALYZING BINARY LATTICE DATA WITH NEAREST-NEIGHBOR PROPERTY
    STRAUSS, DJ
    JOURNAL OF APPLIED PROBABILITY, 1975, 12 (04) : 702 - 712