Crowd Counting Using Meta-Test-Time Adaptation

被引:0
|
作者
Ma, Chaoqun [1 ]
Neri, Ferrante [2 ]
Gu, Li [3 ]
Wang, Ziqiang [3 ]
Wang, Jian [4 ]
Qing, Anyong [1 ]
Wang, Yang [3 ]
机构
[1] Southwest Jiaotong Univ, Sch Elect Engn, Chengdu 611756, Peoples R China
[2] Univ Surrey, Sch Comp Sci & Elect Engn, NICE Grp, Guildford GU2 7XH, Surrey, England
[3] Concordia Univ, Dept Comp Sci & Software Engn, Montreal, PQ H3H 2L9, Canada
[4] Kunming Univ Sci & Technol, Fac Elect Power Engn, Kunming 650500, Peoples R China
关键词
Crowd counting; meta-learning; test-time adaptation; pseudo labels; dropout; NEURAL DYNAMIC CLASSIFICATION; SELECTION; PEOPLE; MODEL;
D O I
10.1142/S0129065724500618
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Machine learning algorithms are commonly used for quickly and efficiently counting people from a crowd. Test-time adaptation methods for crowd counting adjust model parameters and employ additional data augmentation to better adapt the model to the specific conditions encountered during testing. The majority of current studies concentrate on unsupervised domain adaptation. These approaches commonly perform hundreds of epochs of training iterations, requiring a sizable number of unannotated data of every new target domain apart from annotated data of the source domain. Unlike these methods, we propose a meta-test-time adaptive crowd counting approach called CrowdTTA, which integrates the concept of test-time adaptation into the meta-learning framework and makes it easier for the counting model to adapt to the unknown test distributions. To facilitate the reliable supervision signal at the pixel level, we introduce uncertainty by inserting the dropout layer into the counting model. The uncertainty is then used to generate valuable pseudo labels, serving as effective supervisory signals for adapting the model. In the context of meta-learning, one image can be regarded as one task for crowd counting. In each iteration, our approach is a dual-level optimization process. In the inner update, we employ a self-supervised consistency loss function to optimize the model so as to simulate the parameters update process that occurs during the test phase. In the outer update, we authentically update the parameters based on the image with ground truth, improving the model's performance and making the pseudo labels more accurate in the next iteration. At test time, the input image is used for adapting the model before testing the image. In comparison to various supervised learning and domain adaptation methods, our results via extensive experiments on diverse datasets showcase the general adaptive capability of our approach across datasets with varying crowd densities and scales.
引用
收藏
页数:21
相关论文
共 50 条
  • [31] Test-Time Adaptation via Orthogonal Meta-Learning for Medical Imaging
    Wang, Zhiwen
    Lu, Zexin
    Wang, Tao
    Yang, Ziyuan
    Yu, Hui
    Wang, Zhongxian
    Chen, Yinyu
    Lu, Jingfeng
    Zhang, Yi
    IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES, 2025, 9 (02) : 215 - 227
  • [32] Efficient crowd counting model using feature pyramid network and ResNeXt
    Kalyani, G.
    Janakiramaiah, B.
    Prasad, L. V. Narasimha
    Karuna, A.
    Babu, A. Mohan
    SOFT COMPUTING, 2021, 25 (15) : 10497 - 10507
  • [33] Crowd Counting Using End-to-End Semantic Image Segmentation
    Khan, Khalil
    Khan, Rehan Ullah
    Albattah, Waleed
    Nayab, Durre
    Qamar, Ali Mustafa
    Habib, Shabana
    Islam, Muhammad
    ELECTRONICS, 2021, 10 (11)
  • [34] Towards using count-level weak supervision for crowd counting
    Lei, Yinjie
    Liu, Yan
    Zhang, Pingping
    Liu, Lingqiao
    PATTERN RECOGNITION, 2021, 109
  • [35] Crowd counting using cross-adversarial loss and global feature
    Li, Shufang
    Hu, Zhengping
    Zhao, Mengyao
    Sun, Zhe
    JOURNAL OF ELECTRONIC IMAGING, 2020, 29 (05)
  • [36] Scene-specific crowd counting using synthetic training images
    Delussu, Rita
    Putzu, Lorenzo
    Fumera, Giorgio
    PATTERN RECOGNITION, 2022, 124
  • [37] WiCount: A Deep Learning Approach for Crowd Counting Using WiFi Signals
    Liu, Shangqing
    Zhao, Yanchao
    Chen, Bing
    2017 15TH IEEE INTERNATIONAL SYMPOSIUM ON PARALLEL AND DISTRIBUTED PROCESSING WITH APPLICATIONS AND 2017 16TH IEEE INTERNATIONAL CONFERENCE ON UBIQUITOUS COMPUTING AND COMMUNICATIONS (ISPA/IUCC 2017), 2017, : 967 - 974
  • [38] Real-time crowd counting via lightweight scale-aware network
    Zhu, Fushun
    Yan, Hua
    Chen, Xinyue
    Li, Tong
    NEUROCOMPUTING, 2022, 472 : 54 - 67
  • [39] REAL-TIME ACCURATE CROWD COUNTING BASED ON RGB-D INFORMATION
    Fu, Huiyuan
    Ma, Huadong
    Xiao, Hongtian
    2012 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2012), 2012, : 2685 - 2688
  • [40] SCALE-ADAPTIVE REAL-TIME CROWD DETECTION AND COUNTING FOR DRONE IMAGES
    Kuchhold, Markus
    Simon, Maik
    Eiselein, Volker
    Sikora, Thomas
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 943 - 947