CrowdGraph: Weakly supervised Crowd Counting via Pure Graph Neural Network

被引:5
|
作者
Zhang, Chengyang [1 ]
Zhang, Yong [1 ]
Li, Bo [1 ]
Piao, Xinglin [1 ]
Yin, Baocai [1 ]
机构
[1] Beijing Univ Technol, Fac Informat Technol, Beijing Key Lab Multimedia & Intelligent Software, Beijing Artiicial Intelligence Inst, Beijing 100124, Peoples R China
基金
北京市自然科学基金; 国家重点研发计划; 中国国家自然科学基金;
关键词
Crowd counting; weakly supervised learning; graph neural network; uneven distribution of crowds; LOCALIZATION; SCALE;
D O I
10.1145/3638774
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Most existing weakly supervised crowd counting methods utilize Convolutional Neural Networks (CNN) or Transformer to estimate the total number of individuals in an image. However, both CNN-based (grid-to-count paradigm) and Transformer-based (sequence-to-count paradigm) methods take images as inputs in a regular form. This approach treats all pixels equally but cannot address the uneven distribution problem within human crowds. This challenge would lead to a decline in the counting performance of the model. Compared with grid and sequence, the graph structure could better explore the relationship among features. In this article, we propose a new graph-based crowd counting method named CrowdGraph, which reinterprets the weakly supervised crowd counting problem from a graph-to-count perspective. In the proposed CrowdGraph, each image is constructed as a graph, and a graph-based network is designed to extract features at the graph level. CrowdGraph comprises three main components: a dynamic graph convolutional backbone, a multi-scale dilated graph convolution module, and a regression head. To the best of our knowledge, CrowdGraph is the first method that is completely formulated based on the Graph Neural Network (GNN) for the crowd counting task. Extensive experiments demonstrate that the proposed CrowdGraph outperforms pure CNN-based and pure Transformer-based weakly supervised methods comprehensively and achieves highly competitive counting performance.
引用
收藏
页数:23
相关论文
共 50 条
  • [1] A Weakly Supervised Hybrid Lightweight Network for Efficient Crowd Counting
    Chen, Yongqi
    Zhao, Huailin
    Gao, Ming
    Deng, Mingfang
    ELECTRONICS, 2024, 13 (04)
  • [2] TransCrowd: weakly-supervised crowd counting with transformers
    Liang, Dingkang
    Chen, Xiwu
    Xu, Wei
    Zhou, Yu
    Bai, Xiang
    SCIENCE CHINA-INFORMATION SCIENCES, 2022, 65 (06)
  • [3] CrowdMLP: Weakly-supervised crowd counting via multi-granularity MLP
    Wang, Mingjie
    Zhou, Jun
    Cai, Hao
    Gong, Minglun
    PATTERN RECOGNITION, 2023, 144
  • [4] Multi-Level Dynamic Graph Convolutional Networks for Weakly Supervised Crowd Counting
    Miao, Zhuangzhuang
    Zhang, Yong
    Ren, Hao
    Hu, Yongli
    Yin, Baocai
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (05) : 3483 - 3495
  • [5] Learning Crowd Scale and Distribution for Weakly Supervised Crowd Counting and Localization
    Fan, Yaowu
    Wan, Jia
    Ma, Andy J.
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (01) : 713 - 727
  • [6] WEAKLY SUPERVISED CROWD-WISE ATTENTION FOR ROBUST CROWD COUNTING
    Kong, Xiyu
    Zhao, Muming
    Zhou, Hao
    Zhang, Chongyang
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 2722 - 2726
  • [7] Weakly supervised crowd counting based on Swin Transformer
    Feng, Min
    Hao, Linlin
    Kuang, Yonggang
    2023 THE 6TH INTERNATIONAL CONFERENCE ON ROBOT SYSTEMS AND APPLICATIONS, ICRSA 2023, 2023, : 229 - 236
  • [8] CLFormer: a unified transformer-based framework for weakly supervised crowd counting and localization
    Deng, Mingfang
    Zhao, Huailin
    Gao, Ming
    VISUAL COMPUTER, 2024, 40 (02) : 1053 - 1067
  • [9] TransCrowd: weakly-supervised crowd counting with transformers
    Dingkang Liang
    Xiwu Chen
    Wei Xu
    Yu Zhou
    Xiang Bai
    Science China Information Sciences, 2022, 65
  • [10] Application of improved transformer based on weakly supervised in crowd localization and crowd counting
    Gao, Hui
    Zhao, Wenjun
    Zhang, Dexian
    Deng, Miaolei
    SCIENTIFIC REPORTS, 2023, 13 (01)