Active learning for noisy oracle via density power divergence

被引:4
|
作者
Sogawa, Yasuhiro [1 ]
Ueno, Tsuyoshi [2 ]
Kawahara, Yoshinobu [1 ]
Washio, Takashi [1 ]
机构
[1] Osaka Univ, Inst Sci & Ind Res, Osaka, Japan
[2] Japan Sci & Technol Agcy, Minato Discrete Struct Manipulat Syst Project, Kita Ku, Osaka, Japan
关键词
Noisy oracle; Active learning; Density power divergence; ROBUST;
D O I
10.1016/j.neunet.2013.05.007
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The accuracy of active learning is critically influenced by the existence of noisy labels given by a noisy oracle. In this paper, we propose a novel pool-based active learning framework through robust measures based on density power divergence. By minimizing density power divergence, such as a-divergence and gamma-divergence, one can estimate the model accurately even under the existence of noisy labels within data. Accordingly, we develop query selecting measures for pool-based active learning using these divergences. In addition, we propose an evaluation scheme for these measures based on asymptotic statistical analyses, which enables us to perform active learning by evaluating an estimation error directly. Experiments with benchmark datasets and real-world image datasets show that our active learning scheme performs better than several baseline methods. (C) 2013 Elsevier Ltd. All rights reserved.
引用
收藏
页码:133 / 143
页数:11
相关论文
共 50 条
  • [1] Robust Active Learning for Linear Regression via Density Power Divergence
    Sogawa, Yasuhiro
    Ueno, Tsuyoshi
    Kawahara, Yoshinobu
    Washio, Takashi
    NEURAL INFORMATION PROCESSING, ICONIP 2012, PT III, 2012, 7665 : 594 - 602
  • [2] The power divergence and the density power divergence families: the mathematical connection
    Patra S.
    Maji A.
    Basu A.
    Pardo L.
    Sankhya B, 2013, 75 (1) : 16 - 28
  • [3] Characterizing the Functional Density Power Divergence Class
    Ray, Souvik
    Pal, Subrata
    Kar, Sumit Kumar
    Basu, Ayanendranath
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2023, 69 (02) : 1141 - 1146
  • [4] A probabilistic model of active learning with multiple noisy oracles
    Wu, Weining
    Liu, Yang
    Guo, Maozu
    Wang, Chunyu
    Liu, Xiaoyan
    NEUROCOMPUTING, 2013, 118 : 253 - 262
  • [5] Testing statistical hypotheses based on the density power divergence
    Basu, A.
    Mandal, A.
    Martin, N.
    Pardo, L.
    ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 2013, 65 (02) : 319 - 348
  • [6] Active Learning for Graphs with Noisy Structures
    Chi, Hongliang
    Qi, Cong
    Wang, Suhang
    Ma, Yao
    PROCEEDINGS OF THE 2024 SIAM INTERNATIONAL CONFERENCE ON DATA MINING, SDM, 2024, : 262 - 270
  • [7] The Bandwidth from the Density Power Divergence
    Pak, Ro Jin
    COMMUNICATIONS FOR STATISTICAL APPLICATIONS AND METHODS, 2014, 21 (05) : 435 - 444
  • [8] ACTIVE LEARNING FOR EFFICIENT QUERYING FROM A HUMAN ORACLE WITH NOISY RESPONSE IN A LANGUAGE-MODEL ASSISTED BRAIN COMPUTER INTERFACE
    Moghadamfalahi, Mohammad
    Sourati, Jamshid
    Akcakaya, Murat
    Nezamfar, Hooman
    Haghighi, Marzieh
    Erdogmus, Deniz
    2015 IEEE INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING, 2015,
  • [9] Active Learning with Imbalanced Multiple Noisy Labeling
    Zhang, Jing
    Wu, Xindong
    Sheng, Victor S.
    IEEE TRANSACTIONS ON CYBERNETICS, 2015, 45 (05) : 1081 - 1093
  • [10] Consistency of minimizing a penalized density power divergence estimator for mixing distribution
    Lee, Taewook
    Lee, Sangyeol
    STATISTICAL PAPERS, 2009, 50 (01) : 67 - 80