Active learning for noisy oracle via density power divergence

被引:4
作者
Sogawa, Yasuhiro [1 ]
Ueno, Tsuyoshi [2 ]
Kawahara, Yoshinobu [1 ]
Washio, Takashi [1 ]
机构
[1] Osaka Univ, Inst Sci & Ind Res, Osaka, Japan
[2] Japan Sci & Technol Agcy, Minato Discrete Struct Manipulat Syst Project, Kita Ku, Osaka, Japan
关键词
Noisy oracle; Active learning; Density power divergence; ROBUST;
D O I
10.1016/j.neunet.2013.05.007
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The accuracy of active learning is critically influenced by the existence of noisy labels given by a noisy oracle. In this paper, we propose a novel pool-based active learning framework through robust measures based on density power divergence. By minimizing density power divergence, such as a-divergence and gamma-divergence, one can estimate the model accurately even under the existence of noisy labels within data. Accordingly, we develop query selecting measures for pool-based active learning using these divergences. In addition, we propose an evaluation scheme for these measures based on asymptotic statistical analyses, which enables us to perform active learning by evaluating an estimation error directly. Experiments with benchmark datasets and real-world image datasets show that our active learning scheme performs better than several baseline methods. (C) 2013 Elsevier Ltd. All rights reserved.
引用
收藏
页码:133 / 143
页数:11
相关论文
共 50 条
  • [41] Robust tests for the equality of two normal means based on the density power divergence
    Basu, A.
    Mandal, A.
    Martin, N.
    Pardo, L.
    METRIKA, 2015, 78 (05) : 611 - 634
  • [42] Active Learning via Perfect Selective Classification
    El-Yaniv, Ran
    Wiener, Yair
    JOURNAL OF MACHINE LEARNING RESEARCH, 2012, 13 : 255 - 279
  • [43] Active learning via local structure reconstruction
    Li, Qin
    Shi, Xiaoshuang
    Zhou, Linfei
    Sao, Zhifeng
    Guo, Zhenhua
    PATTERN RECOGNITION LETTERS, 2017, 92 : 81 - 88
  • [44] Active Learning for Uneven Noisy Labeled Data in Mention-Level Relation Extraction
    Wei Yuliang
    Xin Guodong
    Wang Wei
    Wang Bailing
    IEEE ACCESS, 2019, 7 : 51648 - 51655
  • [45] Active Learning With Sampling by Uncertainty and Density for Data Annotations
    Zhu, Jingbo
    Wang, Huizhen
    Tsou, Benjamin K.
    Ma, Matthew
    IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2010, 18 (06): : 1323 - 1331
  • [46] Sequential change point test in the presence of outliers: the density power divergence based approach
    Song, Junmo
    ELECTRONIC JOURNAL OF STATISTICS, 2021, 15 (01): : 3504 - 3550
  • [47] Adaptive graph active learning with mutual information via policy learning
    Huang, Yang
    Pi, Yueyang
    Shi, Yiqing
    Guo, Wenzhong
    Wang, Shiping
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 255
  • [48] Hyperspectral image classification via active learning and broad learning system
    Huang, Huifang
    Liu, Zhi
    Chen, C. L. Philip
    Zhang, Yun
    APPLIED INTELLIGENCE, 2023, 53 (12) : 15683 - 15694
  • [49] Hyperspectral image classification via active learning and broad learning system
    Huifang Huang
    Zhi Liu
    C. L. Philip Chen
    Yun Zhang
    Applied Intelligence, 2023, 53 : 15683 - 15694
  • [50] A multi-fidelity active learning method for global design optimization problems with noisy evaluations
    Riccardo Pellegrini
    Jeroen Wackers
    Riccardo Broglia
    Andrea Serani
    Michel Visonneau
    Matteo Diez
    Engineering with Computers, 2023, 39 : 3183 - 3206