Detection of Rice Pests Based on Self-Attention Mechanism and Multi-Scale Feature Fusion

被引:25
|
作者
Hu, Yuqi [1 ,2 ,3 ,4 ]
Deng, Xiaoling [1 ,2 ,3 ,4 ]
Lan, Yubin [1 ,2 ,3 ,4 ]
Chen, Xin [1 ,2 ,3 ,4 ]
Long, Yongbing [1 ,2 ,3 ,4 ]
Liu, Cunjia [5 ]
机构
[1] South China Agr Univ, Coll Elect Engn, Coll Artificial Intelligence, Guangzhou 510642, Peoples R China
[2] Natl Ctr Int Collaborat Res Precis Agr Aviat Pesti, Guangzhou 510642, Peoples R China
[3] Guangdong Lab Lingnan Modern Agr, Guangzhou 510642, Peoples R China
[4] Guangdong Engn Technol Res Ctr Smart Agr, Guangzhou 510642, Peoples R China
[5] Loughborough Univ, Unmanned Vehicles Dept Aeronaut & Automot Engn, Loughborough LE11 3TU, Leics, England
基金
中国国家自然科学基金;
关键词
rice pest detection; YOLOv5; Swin Transformer; BiFPN; self-attention; CLASSIFICATION;
D O I
10.3390/insects14030280
中图分类号
Q96 [昆虫学];
学科分类号
摘要
Simple Summary Various types of rice pests cause huge losses to rice production every year in China. In this paper, a deep neural network for pest detection and classification via digital images is proposed. The targeted optimization is improved for the pest characteristics. Our experiments determined that our model has a higher accuracy and detection speed compared with other methods. In addition, it can be more widely used in pest detection surveys for various crops. In recent years, the occurrence of rice pests has been increasing, which has greatly affected the yield of rice in many parts of the world. The prevention and cure of rice pests is urgent. Aiming at the problems of the small appearance difference and large size change of various pests, a deep neural network named YOLO-GBS is proposed in this paper for detecting and classifying pests from digital images. Based on YOLOv5s, one more detection head is added to expand the detection scale range, the global context (GC) attention mechanism is integrated to find targets in complex backgrounds, PANet is replaced by BiFPN network to improve the feature fusion effect, and Swin Transformer is introduced to take full advantage of the self-attention mechanism of global contextual information. Results from experiments on our insect dataset containing Crambidae, Noctuidae, Ephydridae, and Delphacidae showed that the average mAP of the proposed model is up to 79.8%, which is 5.4% higher than that of YOLOv5s, and the detection effect of various complex scenes is significantly improved. In addition, the paper analyzes and discusses the generalization ability of YOLO-GBS model on a larger-scale pest data set. This research provides a more accurate and efficient intelligent detection method for rice pests and others crop pests.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] Pedestrian detection algorithm based on multi-scale feature extraction and attention feature fusion
    Xia, Hao
    Ma, Jun
    Ou, Jiayu
    Lv, Xinyao
    Bai, Chengjie
    DIGITAL SIGNAL PROCESSING, 2022, 121
  • [22] Uniting Multi-Scale Local Feature Awareness and the Self-Attention Mechanism for Named Entity Recognition
    Shi, Lin
    Zou, Xianming
    Dai, Chenxu
    Ji, Zhanlin
    MATHEMATICS, 2023, 11 (11)
  • [23] MFANet: Multi-scale feature fusion network with attention mechanism
    Wang, Gaihua
    Gan, Xin
    Cao, Qingcheng
    Zhai, Qianyu
    VISUAL COMPUTER, 2023, 39 (07): : 2969 - 2980
  • [24] MFANet: Multi-scale feature fusion network with attention mechanism
    Gaihua Wang
    Xin Gan
    Qingcheng Cao
    Qianyu Zhai
    The Visual Computer, 2023, 39 : 2969 - 2980
  • [25] Research on multimodal hate speech detection based on self-attention mechanism feature fusion
    Mao, Junjie
    Shi, Hanxiao
    Li, Xiaojun
    JOURNAL OF SUPERCOMPUTING, 2025, 81 (01):
  • [26] MFFAMM: A Small Object Detection with Multi-Scale Feature Fusion and Attention Mechanism Module
    Qu, Zhong
    Han, Tongqiang
    Yi, Turning
    APPLIED SCIENCES-BASEL, 2022, 12 (18):
  • [27] Small object detection in remote sensing images based on attention mechanism and multi-scale feature fusion
    Zhang, Li-guo
    Wang, Lei
    Jin, Mei
    Geng, Xing-shuo
    Shen, Qian
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2022, 43 (09) : 3280 - 3297
  • [28] Remote Sensing Small Object Detection Network Based on Attention Mechanism and Multi-Scale Feature Fusion
    Qu, Junsuo
    Tang, Zongbing
    Zhang, Le
    Zhang, Yanghai
    Zhang, Zhenguo
    REMOTE SENSING, 2023, 15 (11)
  • [29] Multi-scale quaternion CNN and BiGRU with cross self-attention feature fusion for fault diagnosis of bearing
    Liu, Huanbai
    Zhang, Fanlong
    Tan, Yin
    Huang, Lian
    Li, Yan
    Huang, Guoheng
    Luo, Shenghong
    Zeng, An
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2024, 35 (08)
  • [30] A Robust Vehicle Detection Model Based on Attention and Multi-scale Feature Fusion
    Zhu, Yuxin
    Liu, Wenbo
    Yan, Fei
    Li, Jun
    2022 14TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING, WCSP, 2022, : 143 - 148