Noise detection in the meta-learning level

被引:47
|
作者
Garcia, Luis P. F. [1 ]
de Carvalho, Andre C. P. L. F. [1 ]
Lorena, Ana C. [2 ]
机构
[1] Univ Sao Paulo, Inst Ciencias Matemat & Comp, Trabalhador Sao Carlense Ave 400, BR-13560970 Sao Paulo, Brazil
[2] Univ Fed Sao Paulo, Inst Ciencia & Tecnol, Talim St 330, Sao Paulo, Brazil
基金
巴西圣保罗研究基金会;
关键词
Noise identification; Characterization measures; Complexity measures; Meta-learning; COMPLEXITY-MEASURES; RANKING;
D O I
10.1016/j.neucom.2014.12.100
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The presence of noise in real data sets can harm the predictive performance of machine learning algorithms. There are several noise filtering techniques whose goal is to improve the quality of the data in classification tasks. These techniques usually scan the data for noise identification in a preprocessing step. Nonetheless, this is a non-trivial task and some noisy data can remain unidentified, while safe data can also be removed. The bias of each filtering technique influences its performance on a particular data set. Therefore, there is no single technique that can be considered the best for all domains or data distribution and choosing a particular filter is not straightforward. Meta-learning has been largely used in the last years to support the recommendation of the most suitable machine learning algorithm(s) for a new data set. This paper presents a meta-learning recommendation system able to predict the expected performance of noise filters in noisy data identification tasks. For such, a meta-base is created, containing meta-features extracted from several corrupted data sets along with the performance of some noise filters when applied to these data sets. Next, regression models are induced from this meta base to predict the expected performance of the investigated filters in the identification of noisy data. The experimental results show that meta-learning can provide a good recommendation of the most promising filters to be applied to new classification data sets. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:14 / 25
页数:12
相关论文
共 50 条
  • [21] Algorithm Design for Online Meta-Learning with Task Boundary Detection
    Sow, Daouda
    Lin, Sen
    Liang, Yingbin
    Zhang, Junshan
    CONFERENCE ON PARSIMONY AND LEARNING, VOL 234, 2024, 234 : 458 - 479
  • [22] Deepfake detection using deep feature stacking and meta-learning
    Naskar, Gourab
    Mohiuddin, Sk
    Malakar, Samir
    Cuevas, Erik
    Sarkar, Ram
    HELIYON, 2024, 10 (04)
  • [23] Fast Adaptation of Radar Detection via Online Meta-learning
    Khan, Zareen
    Jiang, Wei
    Haimovich, Alexander
    Govoni, Mark
    Garner, Timothy
    Simeone, Osvaldo
    2022 56TH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2022, : 580 - 585
  • [24] Critical feature identification and meta-learning method for islanding detection
    Zhang, Peichao
    Tan, Xiaofeng
    Yang, Peixin
    Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2014, 38 (18): : 72 - 78
  • [25] Meta-Learning for Few-Shot Plant Disease Detection
    Chen, Liangzhe
    Cui, Xiaohui
    Li, Wei
    FOODS, 2021, 10 (10)
  • [26] Meta-features for meta-learning
    Rivolli, Adriano
    Garcia, Luis P. F.
    Soares, Carlos
    Vanschoren, Joaquin
    de Carvalho, Andre C. P. L. F.
    KNOWLEDGE-BASED SYSTEMS, 2022, 240
  • [27] Meta-features for meta-learning
    Rivolli, Adriano
    Garcia, Luís P.F.
    Soares, Carlos
    Vanschoren, Joaquin
    de Carvalho, André C.P.L.F.
    Knowledge-Based Systems, 2022, 240
  • [28] MINet: Meta-Learning Instance Identifiers for Video Object Detection
    Deng, Jiajun
    Pan, Yingwei
    Yao, Ting
    Zhou, Wengang
    Li, Houqiang
    Mei, Tao
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 6879 - 6891
  • [29] Meta-learning for fake news detection surrounding the Syrian war
    Abu Salem, Fatima K.
    Al Feel, Roaa
    Elbassuoni, Shady
    Ghannam, Hiyam
    Jaber, Mohamad
    Farah, May
    PATTERNS, 2021, 2 (11):
  • [30] Meta-Modelling Meta-Learning
    Hartmann, Thomas
    Moawad, Assaad
    Schockaert, Cedric
    Fouquet, Francois
    Le Traon, Yves
    2019 ACM/IEEE 22ND INTERNATIONAL CONFERENCE ON MODEL DRIVEN ENGINEERING LANGUAGES AND SYSTEMS (MODELS 2019), 2019, : 300 - 305