Field detection of tiny pests from sticky trap images using deep learning in agricultural greenhouse

被引:94
作者
Li, Wenyong [1 ,2 ]
Wang, Dujin [1 ,2 ]
Li, Ming [1 ,2 ]
Gao, Yulin [3 ]
Wu, Jianwei [1 ,4 ]
Yang, Xinting [1 ,2 ]
机构
[1] Natl Engn Res Ctr Informat Technol Agr, Beijing 100097, Peoples R China
[2] Natl Engn Lab Agriprod Qual Traceabil, Beijing 100097, Peoples R China
[3] Chinese Acad Agr Sci, Inst Plant Protect, State Key Lab Biol Plant Dis & Insect Pests, Beijing 100193, Peoples R China
[4] Beijing PAIDE Sci & Technol Dev Co Ltd, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Pest detection; Whitefly and thrips; Sticky trap; Population estimation; BEMISIA-TABACI; THRIPS;
D O I
10.1016/j.compag.2021.106048
中图分类号
S [农业科学];
学科分类号
09 ;
摘要
Agricultural pest catches on sticky traps can be used for the early detection and identification of hotspots, as well as for estimating relative abundances of adult pests, occurring in greenhouses. This study aimed to construct a detection model for whitefly and thrips from sticky trap images acquired in greenhouse conditions. An end-toend model, based on the Faster regional-convolutional neural network (R-CNN), termed ?TPest-RCNN?, was developed to improve the tiny pest detection accuracy. This architecture was trained using a transfer learning strategy on the Common Objects in Context dataset before training on the tiny pest training set to create the TPest-RCNN model. The new model achieved mean F1 score and average precision of 0.944 and 0.952, respectively, on a validation set. The TPest-RCNN model outperformed the Faster R-CNN architecture and other approaches using handcrafted features (color, shape and/or texture) in detecting multiple species from yellow sticky trap images. The test results also showed the model was robust to detect tiny pests on images of different pest densities and light reflections. Using a linear regression between the manual counts and an automatic detection results using the proposed method on images of 41 days, the determination coefficients reached 99.6% and 97.4% for whitefly and thrips, respectively. These results demonstrated that the proposed method could facilitate rapid gathering of information pertaining to numbers of the abundance of tiny pests in greenhouse agriculture and provide a technical reference for pest monitoring and population estimation.
引用
收藏
页数:11
相关论文
共 34 条
[1]   Evaluation of Yellow Sticky Traps for Monitoring the Population of Thrips (Thysanoptera) in a Mango Orchard [J].
Aliakbarpour, Hamaseh ;
Rawi, Che Salmah Md. .
ENVIRONMENTAL ENTOMOLOGY, 2011, 40 (04) :873-879
[2]   Automatic moth detection from trap images for pest management [J].
Ding, Weiguang ;
Taylor, Graham .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2016, 123 :17-28
[3]  
Dong W., 2017, TELKOMNIKA TELECOMMU, V15
[4]   Combination of image processing and artificial neural networks as a novel approach for the identification of Bemisia tabaci and Frankliniella occidentalis on sticky traps in greenhouse agriculture [J].
Espinoza, Karlos ;
Valera, Diego L. ;
Torres, Jose A. ;
Lopez, Alejandro ;
Molina-Aiz, Francisco D. .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2016, 127 :495-505
[5]   Rich feature hierarchies for accurate object detection and semantic segmentation [J].
Girshick, Ross ;
Donahue, Jeff ;
Darrell, Trevor ;
Malik, Jitendra .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :580-587
[6]  
He KM, 2020, IEEE T PATTERN ANAL, V42, P386, DOI [10.1109/TPAMI.2018.2844175, 10.1109/ICCV.2017.322]
[7]  
Hinton G.E., 2012, INT C NEU INF PRO SY, V25
[8]   FLYOLOv3 deep learning for key parts of dairy cow body detection [J].
Jiang, Bo ;
Wu, Qian ;
Yin, Xuqiang ;
Wu, Dihua ;
Song, Huaibo ;
He, Dongjian .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2019, 166
[9]   AF-RCNN: An anchor-free convolutional neural network for multi-categories agricultural pest detection [J].
Jiao, Lin ;
Dong, Shifeng ;
Zhang, Shengyu ;
Xie, Chengjun ;
Wang, Hongqiang .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2020, 174 (174)
[10]  
Kisantal M., 2019, P CS IT C, V9, P1