CountMamba: Exploring Multi-directional Selective State-Space Models for Plant Counting

被引:0
作者
He, Hulingxiao [1 ]
Zhang, Yaqi [2 ]
Xu, Jinglin [2 ]
Peng, Yuxin [1 ]
机构
[1] Peking Univ, Beijing 100091, Peoples R China
[2] Univ Sci & Technol Beijing, Beijing 100083, Peoples R China
来源
PATTERN RECOGNITION AND COMPUTER VISION, PT XIII, PRCV 2024 | 2025年 / 15043卷
基金
中国国家自然科学基金;
关键词
Smart Agriculture; Plant Counting; State-Space Models; IMAGERY;
D O I
10.1007/978-981-97-8493-6_4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Plant counting is essential in every stage of agriculture, including seed breeding, germination, cultivation, fertilization, pollination yield estimation, and harvesting. Inspired by the fact that humans count objects in high-resolution images by sequential scanning, we explore the potential of handling plant counting tasks via state space models (SSMs) for generating counting results. In this paper, we propose a new counting approach named CountMamba that constructs multiple counting experts to scan from various directions simultaneously. Specifically, we design a Multi-directional State-Space Group to process the image patch sequences in multiple orders and aim to simulate different counting experts. We also design Global-Local Adaptive Fusion to adaptively aggregate global features extracted from multiple directions and local features extracted from the CNN branch in a sample-wise manner. Extensive experiments demonstrate that the proposed CountMamba performs competitively on various plant counting tasks, including maize tassels, wheat ears, and sorghum head counting.
引用
收藏
页码:47 / 61
页数:15
相关论文
共 37 条
[1]   Rice Plant Counting, Locating, and Sizing Method Based on High-Throughput UAV RGB Images [J].
Bai, Xiaodong ;
Liu, Pichao ;
Cao, Zhiguo ;
Lu, Hao ;
Xiong, Haipeng ;
Yang, Aiping ;
Cai, Zhe ;
Wang, Jianjun ;
Yao, Jianguo .
PLANT PHENOMICS, 2023, 5
[2]   A cognitive vision approach to early pest detection in greenhouse crops [J].
Boissard, Paul ;
Martin, Vincent ;
Moisan, Sabine .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2008, 62 (02) :81-93
[3]   YOLACT plus plus Better Real-Time Instance Segmentation [J].
Bolya, Daniel ;
Zhou, Chong ;
Xiao, Fanyi ;
Lee, Yong Jae .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (02) :1108-1121
[4]   Scale Aggregation Network for Accurate and Efficient Crowd Counting [J].
Cao, Xinkun ;
Wang, Zhipeng ;
Zhao, Yanyun ;
Su, Fei .
COMPUTER VISION - ECCV 2018, PT V, 2018, 11209 :757-773
[5]   In-field Triticum aestivum ear counting using colour-texture image analysis [J].
Cointault, F. ;
Guerin, D. ;
Guillemin, J-P. ;
Chopinet, B. .
NEW ZEALAND JOURNAL OF CROP AND HORTICULTURAL SCIENCE, 2008, 36 (02) :117-130
[6]  
Dao T, 2022, Arxiv, DOI [arXiv:2212.14052, 10.48550/arXiv.2212.14052]
[7]  
Donapati R.R., 2023, IEEE Trans. AgriFood Electron
[8]  
Giuffrida M.V., 2016, Learning to count leaves in rosette plants
[9]  
Gu A, 2024, Arxiv, DOI [arXiv:2312.00752, DOI 10.48550/ARXIV.2312.00752]
[10]  
Gu AL, 2022, Arxiv, DOI [arXiv:2111.00396, DOI 10.48550/ARXIV.2111.00396]