An effective pest detection method with automatic data augmentation strategy in the agricultural field

被引:12
作者
Qian, Shaowei [1 ,2 ]
Du, Jianming [1 ]
Zhou, Jianan [3 ]
Xie, Chengjun [1 ]
Jiao, Lin [1 ,4 ]
Li, Rui [1 ,2 ]
机构
[1] Chinese Acad Sci, Hefei Inst Phys Sci, Inst Intelligent Machines, Hefei 230031, Peoples R China
[2] Univ Sci & Technol China, Hefei 230026, Peoples R China
[3] Hunan Univ, Changsha 410000, Peoples R China
[4] Anhui Univ, Sch Internet, Hefei 230031, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Pest detection and recognition; Data augmentation; Computer vision;
D O I
10.1007/s11760-022-02261-9
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Currently, computer vision technology has been applied to detect and recognize pests for integrated pest management (IPM). Recent studies have shown that the accuracy of pest detection and recognition has been rapidly improved with the development of deep learning. However, complex backgrounds, various poses, and different scales among insect species in the field will aggravate the difficulty of pest detection. To address the pest detection and recognition problem in wild field, in this paper, we firstly devise a novel automatic data augmentation method to search for the appropriate augmentation strategy adaptively and model data more effectively. Secondly, Res2Net is used as backbone for obtaining richer detailed information of small pest, and a reverse feature fusion layer is introduced into feature pyramid networks (FPN) to learn more details. During network training, the CIoU bounding box regression loss function and cross entropy loss after label smoothing are introduced for accurate localization and recognition of small pests. When testing, the test time augmentation (TTA) strategy is used to further improve pest detection performance and reduce the probability of missing detection by inferring pest images at different scales. We evaluate the performance of our method on the pest dataset including 4 k images and 4 classes (wheat sawfly, wheat aphid, wheat mite and rice planthopper). Our method achieves the pest detection performance of 81.0% mean Average Precision (mAP), which improves 5.7%, 4.0% and 3.1% compared to three state-of-the-art approaches YOLOv4, Faster R-CNN, and Cascade R-CNN detectors, respectively.
引用
收藏
页码:563 / 571
页数:9
相关论文
共 50 条
[31]   GAN-based semi-automated augmentation online tool for agricultural pest detection: A case study on whiteflies [J].
Karam, Christophe ;
Awad, Mariette ;
Abou Jawdah, Yusuf ;
Ezzeddine, Nour ;
Fardoun, Aya .
FRONTIERS IN PLANT SCIENCE, 2022, 13
[32]   AugMixSpeech: A Data Augmentation Method and Consistency Regularization for Mandarin Automatic Speech Recognition [J].
Jiang, Yang ;
Chen, Jun ;
Han, Kai ;
Liu, Yi ;
Ma, Siqi ;
Song, Yuqing ;
Liu, Zhe .
NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, PT III, NLPCC 2024, 2025, 15361 :145-157
[33]   Real-time and effective detection of agricultural pest using an improved YOLOv5 network [J].
Fang Qi ;
Yuxiang Wang ;
Zhe Tang ;
Shuhong Chen .
Journal of Real-Time Image Processing, 2023, 20
[34]   Real-time and effective detection of agricultural pest using an improved YOLOv5 network [J].
Qi, Fang ;
Wang, Yuxiang ;
Tang, Zhe ;
Chen, Shuhong .
JOURNAL OF REAL-TIME IMAGE PROCESSING, 2023, 20 (02)
[35]   Data Augmentation Effects on Highly Imbalanced EEG Datasets for Automatic Detection of Photoparoxysmal Responses [J].
Moncada Martins, Fernando ;
Gonzalez Suarez, Victor Manuel ;
Villar Flecha, Jose Ramon ;
Garcia Lopez, Beatriz .
SENSORS, 2023, 23 (04)
[36]   Cut-Stitch: A Simple and Effective Data Augmentation Method for Industrial Inspection [J].
Hu, Haigen ;
Hong, Jingshan ;
Song, Kangkang ;
Zhu, Jinwei ;
Ren, Weilun .
MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: RESEARCH TRACK, PT IV, ECML PKDD 2024, 2024, 14944 :403-420
[37]   A mask guided cross data augmentation method for industrial defect detection [J].
Wang, Xubin ;
Li, Wenju ;
Lu, Chang .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2025, 166
[38]   A NOVEL DATA AUGMENTATION METHOD FOR SAR IMAGE TARGET DETECTION AND RECOGNITION [J].
Zhang, Xiaolong ;
Chai, Xinghua ;
Chen, Yanqiao ;
Yang, Zichen ;
Liu, Guangyuan ;
He, Aiyuan ;
Li, Yangyang .
2021 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM IGARSS, 2021, :3581-3584
[39]   Convolutional Neural Network and Data Augmentation Method for Electricity Theft Detection [J].
Zhou, Yu ;
Zhang, Xuecen ;
Tang, Yi ;
Mu, Zhuowen ;
Shao, Xuesong ;
Li, Yue ;
Cai, Qixin .
2021 IEEE IAS INDUSTRIAL AND COMMERCIAL POWER SYSTEM ASIA (IEEE I&CPS ASIA 2021), 2021, :1525-1530
[40]   Spectrum interference-based two-level data augmentation method in deep learning for automatic modulation classification [J].
Qinghe Zheng ;
Penghui Zhao ;
Yang Li ;
Hongjun Wang ;
Yang Yang .
Neural Computing and Applications, 2021, 33 :7723-7745