An effective pest detection method with automatic data augmentation strategy in the agricultural field

被引:12
作者
Qian, Shaowei [1 ,2 ]
Du, Jianming [1 ]
Zhou, Jianan [3 ]
Xie, Chengjun [1 ]
Jiao, Lin [1 ,4 ]
Li, Rui [1 ,2 ]
机构
[1] Chinese Acad Sci, Hefei Inst Phys Sci, Inst Intelligent Machines, Hefei 230031, Peoples R China
[2] Univ Sci & Technol China, Hefei 230026, Peoples R China
[3] Hunan Univ, Changsha 410000, Peoples R China
[4] Anhui Univ, Sch Internet, Hefei 230031, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Pest detection and recognition; Data augmentation; Computer vision;
D O I
10.1007/s11760-022-02261-9
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Currently, computer vision technology has been applied to detect and recognize pests for integrated pest management (IPM). Recent studies have shown that the accuracy of pest detection and recognition has been rapidly improved with the development of deep learning. However, complex backgrounds, various poses, and different scales among insect species in the field will aggravate the difficulty of pest detection. To address the pest detection and recognition problem in wild field, in this paper, we firstly devise a novel automatic data augmentation method to search for the appropriate augmentation strategy adaptively and model data more effectively. Secondly, Res2Net is used as backbone for obtaining richer detailed information of small pest, and a reverse feature fusion layer is introduced into feature pyramid networks (FPN) to learn more details. During network training, the CIoU bounding box regression loss function and cross entropy loss after label smoothing are introduced for accurate localization and recognition of small pests. When testing, the test time augmentation (TTA) strategy is used to further improve pest detection performance and reduce the probability of missing detection by inferring pest images at different scales. We evaluate the performance of our method on the pest dataset including 4 k images and 4 classes (wheat sawfly, wheat aphid, wheat mite and rice planthopper). Our method achieves the pest detection performance of 81.0% mean Average Precision (mAP), which improves 5.7%, 4.0% and 3.1% compared to three state-of-the-art approaches YOLOv4, Faster R-CNN, and Cascade R-CNN detectors, respectively.
引用
收藏
页码:563 / 571
页数:9
相关论文
共 50 条
[41]   Spectrum interference-based two-level data augmentation method in deep learning for automatic modulation classification [J].
Zheng, Qinghe ;
Zhao, Penghui ;
Li, Yang ;
Wang, Hongjun ;
Yang, Yang .
NEURAL COMPUTING & APPLICATIONS, 2021, 33 (13) :7723-7745
[42]   EEG-Based Depression Detection with a Synthesis-Based Data Augmentation Strategy [J].
Wei, Xiangyu ;
Chen, Meifei ;
Wu, Manxi ;
Zhang, Xiaowei ;
Hu, Bin .
BIOINFORMATICS RESEARCH AND APPLICATIONS, ISBRA 2021, 2021, 13064 :484-496
[43]   Feature Refinement Method Based on the Two-Stage Detection Framework for Similar Pest Detection in the Field [J].
Chen, Hongbo ;
Wang, Rujing ;
Du, Jianming ;
Chen, Tianjiao ;
Liu, Haiyun ;
Zhang, Jie ;
Li, Rui ;
Zhou, Guotao .
INSECTS, 2023, 14 (10)
[44]   CIRCULAR SHIFT: AN EFFECTIVE DATA AUGMENTATION METHOD FOR CONVOLUTIONAL NEURAL NETWORK ON IMAGE CLASSIFICATION [J].
Zhang, Kailai ;
Cao, Zheng ;
Wu, Ji .
2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, :1676-1680
[45]   OVERSAMPLING METHOD FOR ENVIRONMENTAL MONITORING DATA AUGMENTATION IN CADMIUM -POLLUTED PADDY FIELD [J].
Hao, Peitong ;
Li, Yue ;
Xu, Weiman ;
Li, Cong ;
Huo, Mingzhu ;
Zhang, Xiaoyu ;
An, Yi .
INTERNATIONAL JOURNAL OF ROBOTICS & AUTOMATION, 2022, 37 (01) :29-36
[46]   I-WAS: A Data Augmentation Method with GPT-2 for Simile Detection [J].
Chang, Yongzhu ;
Zhang, Rongsheng ;
Pu, Jiashu .
DOCUMENT ANALYSIS AND RECOGNITION - ICDAR 2023, PT III, 2023, 14189 :265-279
[47]   Anomaly-GAN: A data augmentation method for train surface anomaly detection [J].
Liu, Ruikang ;
Liu, Weiming ;
Zheng, Zhongxing ;
Wang, Liang ;
Mao, Liang ;
Qiu, Qisheng ;
Ling, Guangzheng .
EXPERT SYSTEMS WITH APPLICATIONS, 2023, 228
[48]   Feature Fusion-Based Data Augmentation Method for Small Object Detection [J].
Wang, Xin ;
Zhang, Hongyan ;
Liu, Qianhe ;
Gong, Wei .
IEEE MULTIMEDIA, 2024, 31 (03) :65-77
[49]   Coating Defect Detection Method Based on Data Augmentation and Network Optimization Design [J].
Tang, Kai ;
Zi, Bin ;
Xu, Feng ;
Zhu, Weidong ;
Feng, Kai .
IEEE SENSORS JOURNAL, 2023, 23 (13) :14522-14533
[50]   An Automated Instance Segmentation Method for Crack Detection Integrated with CrackMover Data Augmentation [J].
Zhao, Mian ;
Xu, Xiangyang ;
Bao, Xiaohua ;
Chen, Xiangsheng ;
Yang, Hao .
SENSORS, 2024, 24 (02)