Noise detection in the meta-learning level

被引:47
|
作者
Garcia, Luis P. F. [1 ]
de Carvalho, Andre C. P. L. F. [1 ]
Lorena, Ana C. [2 ]
机构
[1] Univ Sao Paulo, Inst Ciencias Matemat & Comp, Trabalhador Sao Carlense Ave 400, BR-13560970 Sao Paulo, Brazil
[2] Univ Fed Sao Paulo, Inst Ciencia & Tecnol, Talim St 330, Sao Paulo, Brazil
基金
巴西圣保罗研究基金会;
关键词
Noise identification; Characterization measures; Complexity measures; Meta-learning; COMPLEXITY-MEASURES; RANKING;
D O I
10.1016/j.neucom.2014.12.100
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The presence of noise in real data sets can harm the predictive performance of machine learning algorithms. There are several noise filtering techniques whose goal is to improve the quality of the data in classification tasks. These techniques usually scan the data for noise identification in a preprocessing step. Nonetheless, this is a non-trivial task and some noisy data can remain unidentified, while safe data can also be removed. The bias of each filtering technique influences its performance on a particular data set. Therefore, there is no single technique that can be considered the best for all domains or data distribution and choosing a particular filter is not straightforward. Meta-learning has been largely used in the last years to support the recommendation of the most suitable machine learning algorithm(s) for a new data set. This paper presents a meta-learning recommendation system able to predict the expected performance of noise filters in noisy data identification tasks. For such, a meta-base is created, containing meta-features extracted from several corrupted data sets along with the performance of some noise filters when applied to these data sets. Next, regression models are induced from this meta base to predict the expected performance of the investigated filters in the identification of noisy data. The experimental results show that meta-learning can provide a good recommendation of the most promising filters to be applied to new classification data sets. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:14 / 25
页数:12
相关论文
共 50 条
  • [11] Personalized Hashtag Recommendation with User-level Meta-learning
    Tao, Hemeng
    Khan, Latifur
    Thuraisingham, Bhavani
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [12] Learning to Forget for Meta-Learning
    Baik, Sungyong
    Hong, Seokil
    Lee, Kyoung Mu
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 2376 - 2384
  • [13] Submodular Meta-Learning
    Adibi, Arman
    Mokhtari, Aryan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [14] Online Meta-Learning
    Finn, Chelsea
    Rajeswaran, Aravind
    Kakade, Sham
    Levine, Sergey
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [15] Task-level Relations Modelling for Graph Meta-learning
    Zhou, Yuchen
    Cao, Yanan
    Shang, Yanmin
    Zhou, Chuan
    Song, Chuancheng
    Shi, Fengzhao
    Li, Qian
    2022 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2022, : 813 - 822
  • [16] Meta-learning with backpropagation
    Younger, AS
    Hochreiter, S
    Conwell, PR
    IJCNN'01: INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, PROCEEDINGS, 2001, : 2001 - 2006
  • [17] Competitive Meta-Learning
    Boxi Weng
    Jian Sun
    Gao Huang
    Fang Deng
    Gang Wang
    Jie Chen
    IEEE/CAA Journal of Automatica Sinica, 2023, 10 (09) : 1902 - 1904
  • [18] Robust Meta-learning with Sampling Noise and Label Noise via Eigen-Reptile
    Chen, Dong
    Wu, Lingfei
    Tang, Siliang
    Yun, Xiao
    Long, Bo
    Zhuang, Yueting
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [19] Competitive Meta-Learning
    Weng, Boxi
    Sun, Jian
    Huang, Gao
    Deng, Fang
    Wang, Gang
    Chen, Jie
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2023, 10 (09) : 1902 - 1904
  • [20] Early fault detection for rolling bearings: A meta-learning approach
    Song, Wenbin
    Wu, Di
    Shen, Weiming
    Boulet, Benoit
    IET COLLABORATIVE INTELLIGENT MANUFACTURING, 2024, 6 (02)