Deep Active Learning for Computer Vision: Past and Future

被引:15
作者
Takezoe, Rinyoichi [1 ,2 ]
Liu, Xu [3 ]
Mao, Shunan [2 ]
Chen, Marco Tianyu [4 ]
Feng, Zhanpeng [1 ]
Zhang, Shiliang [2 ]
Wang, Xiaoyu [1 ]
机构
[1] Intellifusion Inc, Beijing, Peoples R China
[2] Peking Univ, Beijing, Peoples R China
[3] Natl Univ Singapore, Singapore, Singapore
[4] Chinese Acad Sci, SIAT, Beijing, Peoples R China
关键词
Computer vision; deep learning; active learning;
D O I
10.1561/116.00000057
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As an important data selection schema, active learning emerges as the essential component when iterating an Artificial Intelligence (AI) model. It becomes even more critical given the dominance of deep neural network based models, which are composed of a large number of parameters and data hungry, in application. Despite its indispensable role for developing AI models, research on active learning is not as intensive as other research directions. In this paper, we present a review of active learning through deep active learning approaches from the following perspectives: (1) technical advancements in active learning, (2) applications of active learning in computer vision, (3) industrial systems leveraging or with potential to leverage active learning for data iteration, (4) current limitations and future research directions. We expect this paper to clarify the significance of active learning in a modern AI model manufacturing process and to bring additional research attention to active learning. By addressing data automation challenges and coping with automated machine learning systems, active learning will facilitate democratization of AI technologies by boosting model production at scale.
引用
收藏
页数:38
相关论文
共 124 条
[1]   Contextual Diversity for Active Learning [J].
Agarwal, Sharat ;
Arora, Himanshu ;
Anand, Saket ;
Arora, Chetan .
COMPUTER VISION - ECCV 2020, PT XVI, 2020, 12361 :137-153
[2]   Active Learning for Deep Detection Neural Networks [J].
Aghdam, Hamed H. ;
Gonzalez-Garcia, Abel ;
van de Weijer, Joost ;
Lopez, Antonio M. .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3671-3679
[3]   Optuna: A Next-generation Hyperparameter Optimization Framework [J].
Akiba, Takuya ;
Sano, Shotaro ;
Yanase, Toshihiko ;
Ohta, Takeru ;
Koyama, Masanori .
KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, :2623-2631
[4]   Deep Active Learning for Text Classification [J].
An, Bang ;
Wu, Wenjun ;
Han, Huimin .
PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON VISION, IMAGE AND SIGNAL PROCESSING (ICVISP 2018), 2018,
[5]  
Andrew N., 2021, ADV NEURAL INFORM PR
[6]  
[Anonymous], 2010, COLING 2010 POSTERS
[7]  
Bao H., 2021, arXiv, DOI DOI 10.48550/ARXIV.2106.08254
[8]   TFX: A TensorFlow-Based Production-Scale Machine Learning Platform [J].
Baylor, Denis ;
Breck, Eric ;
Cheng, Heng-Tze ;
Fiedel, Noah ;
Foo, Chuan Yu ;
Haque, Zakaria ;
Haykal, Salem ;
Ispir, Mustafa ;
Jain, Vihan ;
Koc, Levent ;
Koo, Chiu Yuen ;
Lew, Lukasz ;
Mewald, Clemens ;
Modi, Akshay Naresh ;
Polyzotis, Neoklis ;
Ramesh, Sukriti ;
Roy, Sudip ;
Whang, Steven Euijong ;
Wicke, Martin ;
Wilkiewicz, Jarek ;
Zhang, Xin ;
Zinkevich, Martin .
KDD'17: PROCEEDINGS OF THE 23RD ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2017, :1387-1395
[9]   The power of ensembles for active learning in image classification [J].
Beluch, William H. ;
Genewein, Tim ;
Nuernberger, Andreas ;
Koehler, Jan M. .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :9368-9377
[10]   Reducing Label Effort: Self-Supervised meets Active Learning [J].
Bengar, Javad Zolfaghari ;
van de Weijer, Joost ;
Twardowski, Bartlomiej ;
Raducanu, Bogdan .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, :1631-1639