Active learning for noisy oracle via density power divergence

被引:4
|
作者
Sogawa, Yasuhiro [1 ]
Ueno, Tsuyoshi [2 ]
Kawahara, Yoshinobu [1 ]
Washio, Takashi [1 ]
机构
[1] Osaka Univ, Inst Sci & Ind Res, Osaka, Japan
[2] Japan Sci & Technol Agcy, Minato Discrete Struct Manipulat Syst Project, Kita Ku, Osaka, Japan
关键词
Noisy oracle; Active learning; Density power divergence; ROBUST;
D O I
10.1016/j.neunet.2013.05.007
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The accuracy of active learning is critically influenced by the existence of noisy labels given by a noisy oracle. In this paper, we propose a novel pool-based active learning framework through robust measures based on density power divergence. By minimizing density power divergence, such as a-divergence and gamma-divergence, one can estimate the model accurately even under the existence of noisy labels within data. Accordingly, we develop query selecting measures for pool-based active learning using these divergences. In addition, we propose an evaluation scheme for these measures based on asymptotic statistical analyses, which enables us to perform active learning by evaluating an estimation error directly. Experiments with benchmark datasets and real-world image datasets show that our active learning scheme performs better than several baseline methods. (C) 2013 Elsevier Ltd. All rights reserved.
引用
收藏
页码:133 / 143
页数:11
相关论文
共 50 条
  • [21] Agreeing to disagree: active learning with noisy labels without crowdsourcing
    Mohamed-Rafik Bouguelia
    Slawomir Nowaczyk
    K. C. Santosh
    Antanas Verikas
    International Journal of Machine Learning and Cybernetics, 2018, 9 : 1307 - 1319
  • [22] Agreeing to disagree: active learning with noisy labels without crowdsourcing
    Bouguelia, Mohamed-Rafik
    Nowaczyk, Slawomir
    Santosh, K. C.
    Verikas, Antanas
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2018, 9 (08) : 1307 - 1319
  • [23] Shape Constrained Density Estimation Via Penalized Renyi Divergence
    Koenker, Roger
    Mizera, Ivan
    STATISTICAL SCIENCE, 2018, 33 (04) : 510 - 526
  • [24] Robust Principal Component Analysis using Density Power Divergence
    Roy, Subhrajyoty
    Basu, Ayanendranath
    Ghosh, Abhik
    JOURNAL OF MACHINE LEARNING RESEARCH, 2024, 25
  • [25] Active learning through density clustering
    Wang, Min
    Min, Fan
    Zhang, Zhi-Heng
    Wu, Yan-Xue
    EXPERT SYSTEMS WITH APPLICATIONS, 2017, 85 : 305 - 317
  • [26] Active learning for ranking with sample density
    Cai, Wenbin
    Zhang, Muhan
    Zhang, Ya
    INFORMATION RETRIEVAL JOURNAL, 2015, 18 (02): : 123 - 144
  • [27] Active learning for density peak clustering
    Viet-Vu Vu
    Yoon, Byeongnam
    Cuong Le
    Hong-Quan Do
    Hai-Minh Nguyen
    Chung Tran
    Viet-Thang Vu
    Cong-Mau Tran
    Doan-Vinh Tran
    Tien-Dung Duong
    2022 24TH INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION TECHNOLOGY (ICACT): ARITIFLCIAL INTELLIGENCE TECHNOLOGIES TOWARD CYBERSECURITY, 2022, : 442 - +
  • [28] Learning noisy linear classifiers via adaptive and selective sampling
    Giovanni Cavallanti
    Nicolò Cesa-Bianchi
    Claudio Gentile
    Machine Learning, 2011, 83 : 71 - 102
  • [29] Active learning for ranking with sample density
    Wenbin Cai
    Muhan Zhang
    Ya Zhang
    Information Retrieval Journal, 2015, 18 : 123 - 144
  • [30] Learning noisy linear classifiers via adaptive and selective sampling
    Cavallanti, Giovanni
    Cesa-Bianchi, Nicolo
    Gentile, Claudio
    MACHINE LEARNING, 2011, 83 (01) : 71 - 102