Detection of Rice Pests Based on Self-Attention Mechanism and Multi-Scale Feature Fusion

被引:25
|
作者
Hu, Yuqi [1 ,2 ,3 ,4 ]
Deng, Xiaoling [1 ,2 ,3 ,4 ]
Lan, Yubin [1 ,2 ,3 ,4 ]
Chen, Xin [1 ,2 ,3 ,4 ]
Long, Yongbing [1 ,2 ,3 ,4 ]
Liu, Cunjia [5 ]
机构
[1] South China Agr Univ, Coll Elect Engn, Coll Artificial Intelligence, Guangzhou 510642, Peoples R China
[2] Natl Ctr Int Collaborat Res Precis Agr Aviat Pesti, Guangzhou 510642, Peoples R China
[3] Guangdong Lab Lingnan Modern Agr, Guangzhou 510642, Peoples R China
[4] Guangdong Engn Technol Res Ctr Smart Agr, Guangzhou 510642, Peoples R China
[5] Loughborough Univ, Unmanned Vehicles Dept Aeronaut & Automot Engn, Loughborough LE11 3TU, Leics, England
基金
中国国家自然科学基金;
关键词
rice pest detection; YOLOv5; Swin Transformer; BiFPN; self-attention; CLASSIFICATION;
D O I
10.3390/insects14030280
中图分类号
Q96 [昆虫学];
学科分类号
摘要
Simple Summary Various types of rice pests cause huge losses to rice production every year in China. In this paper, a deep neural network for pest detection and classification via digital images is proposed. The targeted optimization is improved for the pest characteristics. Our experiments determined that our model has a higher accuracy and detection speed compared with other methods. In addition, it can be more widely used in pest detection surveys for various crops. In recent years, the occurrence of rice pests has been increasing, which has greatly affected the yield of rice in many parts of the world. The prevention and cure of rice pests is urgent. Aiming at the problems of the small appearance difference and large size change of various pests, a deep neural network named YOLO-GBS is proposed in this paper for detecting and classifying pests from digital images. Based on YOLOv5s, one more detection head is added to expand the detection scale range, the global context (GC) attention mechanism is integrated to find targets in complex backgrounds, PANet is replaced by BiFPN network to improve the feature fusion effect, and Swin Transformer is introduced to take full advantage of the self-attention mechanism of global contextual information. Results from experiments on our insect dataset containing Crambidae, Noctuidae, Ephydridae, and Delphacidae showed that the average mAP of the proposed model is up to 79.8%, which is 5.4% higher than that of YOLOv5s, and the detection effect of various complex scenes is significantly improved. In addition, the paper analyzes and discusses the generalization ability of YOLO-GBS model on a larger-scale pest data set. This research provides a more accurate and efficient intelligent detection method for rice pests and others crop pests.
引用
收藏
页数:17
相关论文
共 50 条
  • [31] An Image Change Detection Algorithm Based on Multi-Feature Self-Attention Fusion Mechanism UNet Network
    Alimjan, Gulnaz
    Jiaermuhamaiti, Yiliyaer
    Jumahong, Huxidan
    Zhu, Shuangling
    Nurmamat, Pazilat
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2021, 35 (14)
  • [32] Multi-modal speech emotion recognition using self-attention mechanism and multi-scale fusion framework
    Liu, Yang
    Sun, Haoqin
    Guan, Wenbo
    Xia, Yuqi
    Zhao, Zhen
    SPEECH COMMUNICATION, 2022, 139 : 1 - 9
  • [33] Multi-Scale Self-Attention for Text Classification
    Guo, Qipeng
    Qiu, Xipeng
    Liu, Pengfei
    Xue, Xiangyang
    Zhang, Zheng
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 7847 - 7854
  • [34] Multi-modal speech emotion recognition using self-attention mechanism and multi-scale fusion framework
    Liu, Yang
    Sun, Haoqin
    Guan, Wenbo
    Xia, Yuqi
    Zhao, Zhen
    Speech Communication, 2022, 139 : 1 - 9
  • [35] Automated detection of sleep-arousal using multi-scale convolution and self-attention mechanism
    Li F.
    Xu Y.
    Zhang B.
    Cong F.
    Shengwu Yixue Gongchengxue Zazhi/Journal of Biomedical Engineering, 2023, 40 (01): : 27 - 34
  • [36] Video Salient Object Detection Using Multi-Scale Self-Attention
    Liu, Jiahao (jiahao.liu@akane.waseda.jp), 1600, Institute of Electrical and Electronics Engineers Inc.
  • [37] Real-Time Fire Smoke Detection Method Combining a Self-Attention Mechanism and Radial Multi-Scale Feature Connection
    Jin, Chuan
    Zheng, Anqi
    Wu, Zhaoying
    Tong, Changqing
    SENSORS, 2023, 23 (06)
  • [38] Parathyroid Gland Detection Based on Multi-Scale Weighted Fusion Attention Mechanism
    Liu, Wanling
    Lu, Wenhuan
    Li, Yijian
    Chen, Fei
    Jiang, Fan
    Wei, Jianguo
    Wang, Bo
    Zhao, Wenxin
    ELECTRONICS, 2025, 14 (06):
  • [39] Peach Flower Density Detection Based on an Improved CNN Incorporating Attention Mechanism and Multi-Scale Feature Fusion
    Tao, Kun
    Wang, Aichen
    Shen, Yidie
    Lu, Zemin
    Peng, Futian
    Wei, Xinhua
    HORTICULTURAE, 2022, 8 (10)
  • [40] Flower bud detection model for hydroponic Chinese kale based on the fusion of attention mechanism and multi-scale feature
    注意力与多尺度特征融合的水培芥蓝花蕾检测
    Zhen, Wenbin (wenbinzhen@163.com), 1600, Chinese Society of Agricultural Engineering (37): : 161 - 168