A multi-branch convolutional neural network with density map for aphid counting

被引:23
作者
Li, Rui [1 ,2 ,4 ]
Wang, Rujing [1 ,2 ,3 ,4 ]
Xie, Chengjun [1 ,2 ,4 ]
Chen, Hongbo [1 ,2 ,3 ,4 ]
Long, Qi [5 ]
Liu, Liu [6 ]
Zhang, Jie [1 ,2 ,4 ]
Chen, Tianjiao [1 ,2 ,4 ]
Hu, Haiying [1 ,2 ,4 ]
Jiao, Lin [1 ,2 ,3 ,4 ]
Du, Jianming [1 ,2 ,4 ]
Liu, Haiyun [1 ,2 ,3 ,4 ]
机构
[1] Chinese Acad Sci, Inst Intelligent Machines, Hefei 230031, Peoples R China
[2] Chinese Acad Sci, Hefei Inst Phys Sci, Hefei 230031, Peoples R China
[3] Univ Sci & Technol China, Hefei 230026, Peoples R China
[4] Intelligent Agr Engn Lab Anhui Prov, Hefei, Peoples R China
[5] South China Agr Univ, Coll Engn, Guangzhou, Peoples R China
[6] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
Density map; Aphid counting; Convolutional neural network; Deep learning;
D O I
10.1016/j.biosystemseng.2021.11.020
中图分类号
S2 [农业工程];
学科分类号
0828 ;
摘要
In agriculture, aphids always cause major damage in wheat, corn and rape, which significantly affect the crop yield. Manual aphid counting approaches are often labour consuming and time-costing for Integrated Pest Management (IPM). In addition, the results of existing aphid counting methods based on computer vision are not satisfactory due to the complex background and the dense distribution. In order to address these problems, a novel multi-branch convolutional neural network (Mb-CNN) with density map for aphid counting is developed in this paper. In this approach, the aphid images are firstly fed into multi-branch convolutional neural networks, which have three branches for extracting the feature maps of different scales. Then, an aphid density map is generated via Mb-CNN, which contains the distribution information of aphids. Finally, the counting of aphids is estimated by using the density map. Experiment results on our dataset demonstrate that our Mb-CNN achieves the performance of 10.22 Mean Absolute Error (MAE) and 12.24 Mean Squared Error (MSE) in the aphid counting, which outweighs the state-of-the-art approaches. (c) 2021 IAgrE. Published by Elsevier Ltd. All rights reserved.
引用
收藏
页码:148 / 161
页数:14
相关论文
共 28 条
[1]  
Azulay A, 2019, J MACH LEARN RES, V20
[2]   Crowd counting with crowd attention convolutional neural network [J].
Chen, Jiwei ;
Su, Wen ;
Wang, Zengfu .
NEUROCOMPUTING, 2020, 382 :210-220
[3]   Decoupled Two-Stage Crowd Counting and Beyond [J].
Cheng, Jian ;
Xiong, Haipeng ;
Cao, Zhiguo ;
Lu, Hao .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :2862-2875
[4]   Automatic moth detection from trap images for pest management [J].
Ding, Weiguang ;
Taylor, Graham .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2016, 123 :17-28
[5]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[6]   A new mobile application of agricultural pests recognition using deep learning in cloud computing system [J].
Karar, Mohamed Esmail ;
Alsunaydi, Fahad ;
Albusaymi, Sultan ;
Alotaibi, Sultan .
ALEXANDRIA ENGINEERING JOURNAL, 2021, 60 (05) :4423-4432
[7]   An Effective Data Augmentation Strategy for CNN-Based Pest Localization and Recognition in the Field [J].
Li, Rui ;
Wang, Rujing ;
Zhang, Jie ;
Xie, Chengjun ;
Liu, Liu ;
Wang, Fangyuan ;
Chen, Hongbo ;
Chen, Tianjiao ;
Hu, Haiying ;
Jia, Xiufang ;
Hu, Min ;
Zhou, Man ;
Li, Dengshan ;
Liu, Wancai .
IEEE ACCESS, 2019, 7 :160274-160283
[8]   Field detection of tiny pests from sticky trap images using deep learning in agricultural greenhouse [J].
Li, Wenyong ;
Wang, Dujin ;
Li, Ming ;
Gao, Yulin ;
Wu, Jianwei ;
Yang, Xinting .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2021, 183
[9]  
Li Y., 2018, 2018 IEEE C COMPUTER
[10]   Feature Pyramid Networks for Object Detection [J].
Lin, Tsung-Yi ;
Dollar, Piotr ;
Girshick, Ross ;
He, Kaiming ;
Hariharan, Bharath ;
Belongie, Serge .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :936-944