Noise detection in the meta-learning level

被引:47
|
作者
Garcia, Luis P. F. [1 ]
de Carvalho, Andre C. P. L. F. [1 ]
Lorena, Ana C. [2 ]
机构
[1] Univ Sao Paulo, Inst Ciencias Matemat & Comp, Trabalhador Sao Carlense Ave 400, BR-13560970 Sao Paulo, Brazil
[2] Univ Fed Sao Paulo, Inst Ciencia & Tecnol, Talim St 330, Sao Paulo, Brazil
基金
巴西圣保罗研究基金会;
关键词
Noise identification; Characterization measures; Complexity measures; Meta-learning; COMPLEXITY-MEASURES; RANKING;
D O I
10.1016/j.neucom.2014.12.100
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The presence of noise in real data sets can harm the predictive performance of machine learning algorithms. There are several noise filtering techniques whose goal is to improve the quality of the data in classification tasks. These techniques usually scan the data for noise identification in a preprocessing step. Nonetheless, this is a non-trivial task and some noisy data can remain unidentified, while safe data can also be removed. The bias of each filtering technique influences its performance on a particular data set. Therefore, there is no single technique that can be considered the best for all domains or data distribution and choosing a particular filter is not straightforward. Meta-learning has been largely used in the last years to support the recommendation of the most suitable machine learning algorithm(s) for a new data set. This paper presents a meta-learning recommendation system able to predict the expected performance of noise filters in noisy data identification tasks. For such, a meta-base is created, containing meta-features extracted from several corrupted data sets along with the performance of some noise filters when applied to these data sets. Next, regression models are induced from this meta base to predict the expected performance of the investigated filters in the identification of noisy data. The experimental results show that meta-learning can provide a good recommendation of the most promising filters to be applied to new classification data sets. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:14 / 25
页数:12
相关论文
共 50 条
  • [1] Meta-learning for Robust Anomaly Detection
    Kumagai, Atsutoshi
    Iwata, Tomoharu
    Takahashi, Hiroshi
    Fujiwara, Yasuhiro
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 206, 2023, 206 : 675 - 691
  • [2] Tracking by Instance Detection: A Meta-Learning Approach
    Wang, Guangting
    Luo, Chong
    Sun, Xiaoyan
    Xiong, Zhiwei
    Zeng, Wenjun
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 6287 - 6296
  • [3] Incremental Object Detection via Meta-Learning
    Joseph, K. J.
    Rajasegaran, Jathushan
    Khan, Salman
    Khan, Fahad Shahbaz
    Balasubramanian, Vineeth N.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (12) : 9209 - 9216
  • [4] Lightweight Meta-Learning BotNet Attack Detection
    Fadhilla, Cut Alna
    Alfikri, Muhammad Dany
    Kaliski, Rafael
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (10) : 8455 - 8466
  • [5] Hierarchical Noise-Tolerant Meta-Learning With Noisy Labels
    Liu, Yahui
    Wang, Jian
    Yang, Yuntai
    Wang, Renlong
    Wang, Simiao
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 3020 - 3024
  • [6] Learning Meta-Learning (LML) dataset: Survey data of meta-learning parameters
    Corraya, Sonia
    Al Mamun, Shamim
    Kaiser, M. Shamim
    DATA IN BRIEF, 2023, 51
  • [7] Federated Meta-Learning for Fraudulent Credit Card Detection
    Zheng, Wenbo
    Yan, Lan
    Gou, Chao
    Wang, Fei-Yue
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 4654 - 4660
  • [8] Active Meta-Learning with Uncertainty Sampling and Outlier Detection
    Prudencio, Ricardo B. C.
    Ludermir, Teresa B.
    2008 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-8, 2008, : 346 - 351
  • [9] On the Effectiveness of Sentence Encoding for Intent Detection Meta-Learning
    Ma, Tingting
    Wu, Qianhui
    Yu, Zhiwei
    Zhao, Tiejun
    Lin, Chin-Yew
    NAACL 2022: THE 2022 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES, 2022, : 3806 - 3818
  • [10] Meta-learning in Reinforcement Learning
    Schweighofer, N
    Doya, K
    NEURAL NETWORKS, 2003, 16 (01) : 5 - 9