Crowd Counting Using Meta-Test-Time Adaptation

被引:0
|
作者
Ma, Chaoqun [1 ]
Neri, Ferrante [2 ]
Gu, Li [3 ]
Wang, Ziqiang [3 ]
Wang, Jian [4 ]
Qing, Anyong [1 ]
Wang, Yang [3 ]
机构
[1] Southwest Jiaotong Univ, Sch Elect Engn, Chengdu 611756, Peoples R China
[2] Univ Surrey, Sch Comp Sci & Elect Engn, NICE Grp, Guildford GU2 7XH, Surrey, England
[3] Concordia Univ, Dept Comp Sci & Software Engn, Montreal, PQ H3H 2L9, Canada
[4] Kunming Univ Sci & Technol, Fac Elect Power Engn, Kunming 650500, Peoples R China
关键词
Crowd counting; meta-learning; test-time adaptation; pseudo labels; dropout; NEURAL DYNAMIC CLASSIFICATION; SELECTION; PEOPLE; MODEL;
D O I
10.1142/S0129065724500618
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Machine learning algorithms are commonly used for quickly and efficiently counting people from a crowd. Test-time adaptation methods for crowd counting adjust model parameters and employ additional data augmentation to better adapt the model to the specific conditions encountered during testing. The majority of current studies concentrate on unsupervised domain adaptation. These approaches commonly perform hundreds of epochs of training iterations, requiring a sizable number of unannotated data of every new target domain apart from annotated data of the source domain. Unlike these methods, we propose a meta-test-time adaptive crowd counting approach called CrowdTTA, which integrates the concept of test-time adaptation into the meta-learning framework and makes it easier for the counting model to adapt to the unknown test distributions. To facilitate the reliable supervision signal at the pixel level, we introduce uncertainty by inserting the dropout layer into the counting model. The uncertainty is then used to generate valuable pseudo labels, serving as effective supervisory signals for adapting the model. In the context of meta-learning, one image can be regarded as one task for crowd counting. In each iteration, our approach is a dual-level optimization process. In the inner update, we employ a self-supervised consistency loss function to optimize the model so as to simulate the parameters update process that occurs during the test phase. In the outer update, we authentically update the parameters based on the image with ground truth, improving the model's performance and making the pseudo labels more accurate in the next iteration. At test time, the input image is used for adapting the model before testing the image. In comparison to various supervised learning and domain adaptation methods, our results via extensive experiments on diverse datasets showcase the general adaptive capability of our approach across datasets with varying crowd densities and scales.
引用
收藏
页数:21
相关论文
共 50 条
  • [21] Crowd Counting Using Region Convolutional Neural Networks
    Akbar, Naufal
    Djamal, Esmeralda Contessa
    2021 8TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING, COMPUTERSCIENCE AND INFORMATICS (EECSI) 2021, 2021, : 359 - 364
  • [22] Dynamic Momentum Adaptation for Zero-Shot Cross-Domain Crowd Counting
    Wu, Qiangqiang
    Wan, Jia
    Chan, Antoni B.
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 658 - 666
  • [23] Head-Aware Density Adaptation Networks for Cross-Domain Crowd Counting
    Cai Y.
    Ma Z.
    Wang T.
    Lyu C.
    Wang C.
    He G.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2021, 33 (10): : 1514 - 1523
  • [24] Real-time Crowd Counting based on Wearable Ephemeral IDs
    Morales, Daniel
    Agudo, Isaac
    Lopez, Javier
    SECRYPT : PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON SECURITY AND CRYPTOGRAPHY, 2022, : 249 - 260
  • [25] GIGAPIXEL-LEVEL IMAGE CROWD COUNTING USING CSRNET
    Cao, Zhijie
    Yan, Renyou
    Huang, Yiyong
    Shi, Zhiru
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2019, : 426 - 428
  • [26] Scene-adaptive crowd counting method based on meta learning with dual-input network DMNet
    Zhao, Haoyu
    Min, Weidong
    Xu, Jianqiang
    Wang, Qi
    Zou, Yi
    Fu, Qiyan
    FRONTIERS OF COMPUTER SCIENCE, 2023, 17 (01)
  • [27] Scene-adaptive crowd counting method based on meta learning with dual-input network DMNet
    Haoyu Zhao
    Weidong Min
    Jianqiang Xu
    Qi Wang
    Yi Zou
    Qiyan Fu
    Frontiers of Computer Science, 2023, 17
  • [28] Crowd Counting and Individual Localization Using Pseudo Square Label
    Ryu, Jihye
    Song, Kwangho
    IEEE ACCESS, 2024, 12 : 68160 - 68170
  • [29] Need Only One More Point (NOOMP): Perspective Adaptation Crowd Counting in Complex Scenes
    Zhao, Haoyu
    Wang, Qi
    Zhan, Guowei
    Min, Weidong
    Zou, Yi
    Cui, Shimiao
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 1414 - 1426
  • [30] Multi-image Crowd Counting Using Multi-column Convolutional Neural Network
    Kurnaz, Oguzhan
    Hanilci, Cemal
    PROCEEDINGS OF SIXTH INTERNATIONAL CONGRESS ON INFORMATION AND COMMUNICATION TECHNOLOGY (ICICT 2021), VOL 2, 2022, 236 : 223 - 232