Crowd Counting Using Meta-Test-Time Adaptation

被引:0
|
作者
Ma, Chaoqun [1 ]
Neri, Ferrante [2 ]
Gu, Li [3 ]
Wang, Ziqiang [3 ]
Wang, Jian [4 ]
Qing, Anyong [1 ]
Wang, Yang [3 ]
机构
[1] Southwest Jiaotong Univ, Sch Elect Engn, Chengdu 611756, Peoples R China
[2] Univ Surrey, Sch Comp Sci & Elect Engn, NICE Grp, Guildford GU2 7XH, Surrey, England
[3] Concordia Univ, Dept Comp Sci & Software Engn, Montreal, PQ H3H 2L9, Canada
[4] Kunming Univ Sci & Technol, Fac Elect Power Engn, Kunming 650500, Peoples R China
关键词
Crowd counting; meta-learning; test-time adaptation; pseudo labels; dropout; NEURAL DYNAMIC CLASSIFICATION; SELECTION; PEOPLE; MODEL;
D O I
10.1142/S0129065724500618
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Machine learning algorithms are commonly used for quickly and efficiently counting people from a crowd. Test-time adaptation methods for crowd counting adjust model parameters and employ additional data augmentation to better adapt the model to the specific conditions encountered during testing. The majority of current studies concentrate on unsupervised domain adaptation. These approaches commonly perform hundreds of epochs of training iterations, requiring a sizable number of unannotated data of every new target domain apart from annotated data of the source domain. Unlike these methods, we propose a meta-test-time adaptive crowd counting approach called CrowdTTA, which integrates the concept of test-time adaptation into the meta-learning framework and makes it easier for the counting model to adapt to the unknown test distributions. To facilitate the reliable supervision signal at the pixel level, we introduce uncertainty by inserting the dropout layer into the counting model. The uncertainty is then used to generate valuable pseudo labels, serving as effective supervisory signals for adapting the model. In the context of meta-learning, one image can be regarded as one task for crowd counting. In each iteration, our approach is a dual-level optimization process. In the inner update, we employ a self-supervised consistency loss function to optimize the model so as to simulate the parameters update process that occurs during the test phase. In the outer update, we authentically update the parameters based on the image with ground truth, improving the model's performance and making the pseudo labels more accurate in the next iteration. At test time, the input image is used for adapting the model before testing the image. In comparison to various supervised learning and domain adaptation methods, our results via extensive experiments on diverse datasets showcase the general adaptive capability of our approach across datasets with varying crowd densities and scales.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] Cross Domain Adaptation of Crowd Counting with Model-Agnostic Meta-Learning
    Hou, Xiaoyu
    Xu, Jihui
    Wu, Jinming
    Xu, Huaiyu
    APPLIED SCIENCES-BASEL, 2021, 11 (24):
  • [2] Domain Adaptation in Crowd Counting
    Hossain, Mohammad Asiful
    Reddy, Mahesh Kumar Krishna
    Cannons, Kevin
    Xu, Zhan
    Wang, Yang
    2020 17TH CONFERENCE ON COMPUTER AND ROBOT VISION (CRV 2020), 2020, : 150 - 157
  • [3] MetaUSACC: Unlabeled scene adaptation for crowd counting via meta-auxiliary learning
    Ma, Chaoqun
    Zeng, Jia
    Shao, Penghui
    Qing, Anyong
    Wang, Yang
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 247
  • [4] AdaCrowd: Unlabeled Scene Adaptation for Crowd Counting
    Reddy, Mahesh Kumar Krishna
    Rochan, Mrigank
    Lu, Yiwei
    Wang, Yang
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 1008 - 1019
  • [5] Crowd Counting using Multiple Local Features
    Ryan, David
    Denman, Simon
    Fookes, Clinton
    Sridharan, Sridha
    2009 DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA 2009), 2009, : 81 - 88
  • [6] Crowd Counting Using Adaptive Segmentation in a Congregation
    Sajid, Muhamad
    Hassan, Ali
    Khan, Shoab A.
    2016 IEEE INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING (ICSIP), 2016, : 745 - 749
  • [7] SELF-SUPERVISED DOMAIN ADAPTATION IN CROWD COUNTING
    Nguyen, Pha
    Truong, Thanh-Dat
    Huang, Miaoqing
    Liang, Yi
    Le, Ngan
    Luu, Khoa
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 2786 - 2790
  • [8] Cross-Domain Attention Network for Unsupervised Domain Adaptation Crowd Counting
    Zhang, Anran
    Xu, Jun
    Luo, Xiaoyan
    Cao, Xianbin
    Zhen, Xiantong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (10) : 6686 - 6699
  • [9] Crowd Counting Using Deep Learning in Edge Devices
    Huang, Zuo
    Sinnott, Richard O.
    Ke, Qiuhong
    8TH IEEE/ACM INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING, APPLICATIONS AND TECHNOLOGIES, BDCAT 2021, 2021, : 28 - 37
  • [10] Unlabeled scene adaptive crowd counting via meta-ensemble learning
    Ma, Chaoqun
    Zeng, Jia
    Shao, Penghui
    Qing, Anyong
    Wang, Yang
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2024, 159