An efficient mobile model for insect image classification in the field pest management

被引:14
作者
Zheng, Tengfei [1 ,2 ,3 ]
Yang, Xinting [1 ,2 ,3 ]
Lv, Jiawei [2 ,3 ,5 ]
Li, Ming [2 ,3 ]
Wang, Shanning [4 ]
Li, Wenyong [2 ,3 ]
机构
[1] Shanghai Ocean Univ, Coll Informat, Shanghai 201306, Peoples R China
[2] Natl Engn Res Ctr Informat Technol Agr, Beijing 100097, Peoples R China
[3] Natl Engn Lab Agriprod Qual Traceabil, Beijing 100097, Peoples R China
[4] Beijing Acad Agr & Forestry Sci, Inst Plant Protect, Beijing Key Lab Environm Friendly Management Fruit, Beijing 100097, Peoples R China
[5] Zhongkai Univ Agr & Engn, Coll Informat Sci & Technol, Guangzhou 510225, Peoples R China
来源
ENGINEERING SCIENCE AND TECHNOLOGY-AN INTERNATIONAL JOURNAL-JESTECH | 2023年 / 39卷
关键词
Insect recognition; Lightweight model; Attention mechanism; Feature fusion; Data augmentation;
D O I
10.1016/j.jestch.2023.101335
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Accurately recognizing insect pest in their larva phase is significant to take the early treatment on the infected crops, thus helping timely reduce the yield loss in agricultural products. The convolutional neu-ral networks (CNNs)-based classification methods have become the most competitive methods to address many technical challenges related to image recognition in the field. Focusing on accurate and small mod-els carried on mobile devices, this study proposed a novel pest classification method PCNet (Pest Classification Network) based on lightweight CNNs embedded attention mechanism. PCNet was designed with EfficientNet V2 as the backbone, and the coordinate attention mechanism (CA) was incorporated in this architecture to learn the inter-channel pest information and pest positional information of input images. Moreover, combining the feature maps output by mobile inverted bottleneck (MBConv) with the feature maps output by average pooling to develop the feature fusion module, which implements the feature fusion between shallow layers and deep layers to address the loss of insect pest features in the down-sampling procedures. In addition, a stochastic, pipeline-based data augmentation approach was adopted to randomly enhance data diversity and thus avoid model overfitting. The experimental results show that the PCNet model achieved recognition accuracy of 98.4 % on the self-built dataset con-sisting of 30 classes of larvae, which outperforms three classic CNN models (AlexNet, VGG16, and ResNet101), and four lightweight CNN models (ShuffleNet V2, MobileNet V3, EfficientNet V1 and V2). To further verify the robustness on different datasets, the proposed model was also tested on two other public datasets: IP102 and miniImageNet. The recognition accuracy of PCNet is 73.7 % on the IP102 data -set, outperforming other models and 94.0 % on miniImageNet dataset, which is only lower than that of ResNet101 and MobileNet V3. The number of PCNet parameters is 20.7 M, which is less than those of tra-ditional classic CNN models. The satisfactory accuracy and small size of this model makes it suitable for real-time pest recognition in the field with resource constrained mobile devices. Our code will be avail-able at https://github.com/pby521/PCNet/tree/master. (c) 2023 Karabuk University. Publishing services by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页数:13
相关论文
共 33 条
[1]   Cotton pests classification in field-based images using deep residual networks [J].
Alves, Adao Nunes ;
Souza, Witenberg S. R. ;
Borges, Dibio Leandro .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2020, 174
[2]   Plant leaf disease classification using EfficientNet deep learning model [J].
Atila, Umit ;
Ucar, Murat ;
Akyol, Kemal ;
Ucar, Emine .
ECOLOGICAL INFORMATICS, 2021, 61
[3]   Crop pest classification with a genetic algorithm-based weighted ensemble of deep convolutional neural networks [J].
Ayan, Enes ;
Erbay, Hasan ;
Varcin, Fatih .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2020, 179
[4]   Lightweight convolutional neural network model for field wheat ear disease identification [J].
Bao, Wenxia ;
Yang, Xinghua ;
Liang, Dong ;
Hu, Gensheng ;
Yang, Xianjun .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2021, 189
[5]   Biomedical image augmentation using Augmentor [J].
Bloice, Marcus D. ;
Roth, Peter M. ;
Holzinger, Andreas .
BIOINFORMATICS, 2019, 35 (21) :4522-4524
[6]   Xception: Deep Learning with Depthwise Separable Convolutions [J].
Chollet, Francois .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1800-1807
[7]   Automatic moth detection from trap images for pest management [J].
Ding, Weiguang ;
Taylor, Graham .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2016, 123 :17-28
[8]   Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1026-1034
[9]  
Hou QB, 2021, Arxiv, DOI [arXiv:2103.02907, 10.48550/arXiv.2103.02907]
[10]  
Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/TPAMI.2019.2913372, 10.1109/CVPR.2018.00745]