CVPR 2020 continual learning in computer vision competition: Approaches, results, current challenges and future directions

被引:26
作者
Lomonaco, Vincenzo [1 ,2 ]
Pellegrini, Lorenzo [1 ]
Rodriguez, Pau [3 ]
Caccia, Massimo [3 ,4 ]
She, Qi [2 ,8 ]
Chen, Yu [9 ]
Jodelet, Quentin [10 ,11 ]
Wang, Ruiping [12 ]
Mai, Zheda [13 ]
Vazquez, David [3 ]
Parisi, German, I [2 ,5 ]
Churamani, Nikhil [6 ]
Pickett, Marc [7 ]
Laradji, Issam [3 ]
Maltoni, Davide [1 ]
机构
[1] Univ Bologna, Bologna, Italy
[2] ContinualAI Res, Bologna, Italy
[3] Element AI, Toronto, ON, Canada
[4] MILA, Montreal, PQ, Canada
[5] Univ Hamburg, Hamburg, Germany
[6] Univ Cambridge, Cambridge, England
[7] Google AI, Mountain View, CA USA
[8] ByteDance AI Labs, Beijing, Peoples R China
[9] Univ Bristol, Bristol, Avon, England
[10] Tokyo Inst Technol, Tokyo, Japan
[11] AIST RWBC OIL, Tokyo, Japan
[12] Chinese Acad Sci, Beijing, Peoples R China
[13] Univ Toronto, Toronto, ON, Canada
关键词
Continual learning; Lifelong learning; Incremental learning; Challenge; Computer vision;
D O I
10.1016/j.artint.2021.103635
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the last few years, we have witnessed a renewed and fast-growing interest in continual learning with deep neural networks with the shared objective of making current AI systems more adaptive, efficient and autonomous. However, despite the significant and undoubted progress of the field in addressing the issue of catastrophic forgetting, benchmarking different continual learning approaches is a difficult task by itself. In fact, given the proliferation of different settings, training and evaluation protocols, metrics and nomenclature, it is often tricky to properly characterize a continual learning algorithm, relate it to other solutions and gauge its real-world applicability. The first Continual Learning in Computer Vision challenge held at CVPR in 2020 has been one of the first opportunities to evaluate different continual learning algorithms on a common hardware with a large set of shared evaluation metrics and 3 different settings based on the realistic CORe50 video benchmark. In this paper, we report the main results of the competition, which counted more than 79 teams registered and 11 finalists. We also summarize the winning approaches, current challenges and future research directions. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:14
相关论文
共 36 条
[1]  
[Anonymous], 2009, Learning multiple layers of features from tiny images
[2]  
[Anonymous], 2009, Dataset shift in machine learning
[3]   IROS 2019 Lifelong Robotic Vision: Object Recognition Challenge [J].
Bae, Heechul ;
Brophy, Eoin ;
Chan, Rosa H. M. ;
Chen, Baoquan ;
Feng, Fan ;
Graffieti, Gabriele ;
Goel, Vidit ;
Hao, Xinyue ;
Han, Hyonyoung ;
Kanagarajah, Sathursan ;
Kumar, Somesh ;
Lam, Siew-Kei ;
Lam, Tin Lun ;
Lan, Chuanlin ;
Liu, Qi ;
Lomonaco, Vincenzo ;
Ma, Liang ;
Maltoni, Davide ;
Parisi, German I. ;
Pellegrini, Lorenzo ;
Piyasena, Duvindu ;
Pu, Shiliang ;
She, Qi ;
Sheet, Debdoot ;
Song, Soonyong ;
Son, Youngsung ;
Wang, Zhengwei ;
Ward, Tomas E. ;
Wu, Jianwen ;
Wu, Meiqing ;
Xie, Di ;
Xu, Yangsheng ;
Yang, Lin ;
Yang, Qihan ;
Zhong, Qiaoyong ;
Zhou, Liguang .
IEEE ROBOTICS & AUTOMATION MAGAZINE, 2020, 27 (02) :11-16
[4]   A systematic study of the class imbalance problem in convolutional neural networks [J].
Buda, Mateusz ;
Maki, Atsuto ;
Mazurowski, Maciej A. .
NEURAL NETWORKS, 2018, 106 :249-259
[5]  
Caccia L., 2019, ONLINE LEARNED CONTI
[6]  
Caccia M, 2020, ADV NEUR IN, V33
[7]  
Chaudhry Arslan, 2019, Continual learning with tiny episodic memories
[8]  
Chen Y.C., 2020, ARXIV200300517
[9]   The Animal-AI Olympics [J].
Crosby, Matthew ;
Beyret, Benjamin ;
Halina, Marta .
NATURE MACHINE INTELLIGENCE, 2019, 1 (05) :257-257
[10]  
Diaz-Rodriguez N., 2018, WORKSH CONT LEARN NE