Crowd Counting Using Meta-Test-Time Adaptation

被引:0
|
作者
Ma, Chaoqun [1 ]
Neri, Ferrante [2 ]
Gu, Li [3 ]
Wang, Ziqiang [3 ]
Wang, Jian [4 ]
Qing, Anyong [1 ]
Wang, Yang [3 ]
机构
[1] Southwest Jiaotong Univ, Sch Elect Engn, Chengdu 611756, Peoples R China
[2] Univ Surrey, Sch Comp Sci & Elect Engn, NICE Grp, Guildford GU2 7XH, Surrey, England
[3] Concordia Univ, Dept Comp Sci & Software Engn, Montreal, PQ H3H 2L9, Canada
[4] Kunming Univ Sci & Technol, Fac Elect Power Engn, Kunming 650500, Peoples R China
关键词
Crowd counting; meta-learning; test-time adaptation; pseudo labels; dropout; NEURAL DYNAMIC CLASSIFICATION; SELECTION; PEOPLE; MODEL;
D O I
10.1142/S0129065724500618
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Machine learning algorithms are commonly used for quickly and efficiently counting people from a crowd. Test-time adaptation methods for crowd counting adjust model parameters and employ additional data augmentation to better adapt the model to the specific conditions encountered during testing. The majority of current studies concentrate on unsupervised domain adaptation. These approaches commonly perform hundreds of epochs of training iterations, requiring a sizable number of unannotated data of every new target domain apart from annotated data of the source domain. Unlike these methods, we propose a meta-test-time adaptive crowd counting approach called CrowdTTA, which integrates the concept of test-time adaptation into the meta-learning framework and makes it easier for the counting model to adapt to the unknown test distributions. To facilitate the reliable supervision signal at the pixel level, we introduce uncertainty by inserting the dropout layer into the counting model. The uncertainty is then used to generate valuable pseudo labels, serving as effective supervisory signals for adapting the model. In the context of meta-learning, one image can be regarded as one task for crowd counting. In each iteration, our approach is a dual-level optimization process. In the inner update, we employ a self-supervised consistency loss function to optimize the model so as to simulate the parameters update process that occurs during the test phase. In the outer update, we authentically update the parameters based on the image with ground truth, improving the model's performance and making the pseudo labels more accurate in the next iteration. At test time, the input image is used for adapting the model before testing the image. In comparison to various supervised learning and domain adaptation methods, our results via extensive experiments on diverse datasets showcase the general adaptive capability of our approach across datasets with varying crowd densities and scales.
引用
收藏
页数:21
相关论文
共 50 条
  • [41] MobileCount: An efficient encoder-decoder framework for real-time crowd counting
    Wang, Peng
    Gao, Chenyu
    Wang, Yang
    Li, Hui
    Gao, Ye
    NEUROCOMPUTING, 2020, 407 : 292 - 299
  • [42] Dense crowd counting based on perspective weight model using a fisheye camera
    Hu, Xuemin
    Zheng, Hong
    Chen, Yuzhang
    Chen, Long
    OPTIK, 2015, 126 (01): : 123 - 130
  • [43] Crowd counting using statistical features based on curvelet frame change detection
    Hafeezallah, Adel
    Abu-Bakar, Syed
    MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (14) : 15777 - 15799
  • [44] Test-Time Adaptation for Optical Flow Estimation Using Motion Vectors
    Ayyoubzadeh, Seyed Mehdi
    Liu, Wentao
    Kezele, Irina
    Yu, Yuanhao
    Wu, Xiaolin
    Wang, Yang
    Jin, Tang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 4977 - 4988
  • [45] Crowd counting using statistical features based on curvelet frame change detection
    Adel Hafeezallah
    Syed Abu-Bakar
    Multimedia Tools and Applications, 2017, 76 : 15777 - 15799
  • [46] Adaptive Scheme for Crowd Counting Using off-the-Shelf Wireless Routers
    Zhuang, Wei
    Shen, Yixian
    Gao, Chunming
    Li, Lu
    Sang, Haoran
    Qian, Fei
    COMPUTER SYSTEMS SCIENCE AND ENGINEERING, 2022, 41 (01): : 255 - 269
  • [47] Convolutional Neural Network Method for Crowd Counting Improved using Involution Operator
    Li Zhaoxin
    Lu Shuhua
    Lan Lingqiang
    Liu Qiyuan
    LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (18)
  • [48] Online Adaptive Fault Diagnosis With Test-Time Domain Adaptation
    Wu, Kangkai
    Li, Jingjing
    Meng, Lichao
    Li, Fengling
    Lu, Ke
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2025, 21 (01) : 107 - 117
  • [49] CrowdDCNN: Deep convolution neural network for real-time crowd counting on IoT edge
    Chavan, Rugved
    Kanamarlapudi, Aravind
    Rani, Geeta
    Thakkar, Priyam
    Dhaka, Vijaypal Singh
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 126
  • [50] Test-Time Adaptation for Egocentric Action Recognition
    Plananamente, Mirco
    Plizzari, Chiara
    Caputo, Barbara
    IMAGE ANALYSIS AND PROCESSING, ICIAP 2022, PT III, 2022, 13233 : 206 - 218