YOLOv5-Tassel: Detecting Tassels in RGB UAV Imagery With Improved YOLOv5 Based on Transfer Learning

被引:208
作者
Liu, Wei [1 ]
Quijano, Karoll [2 ]
Crawford, Melba M. [1 ,3 ]
机构
[1] Purdue Univ, Sch Elect & Comp Engn, W Lafayette, IN 47907 USA
[2] Purdue Univ, Dept Environm & Ecol Engn, W Lafayette, IN 47907 USA
[3] Purdue Univ, Lyles Sch Civil Engn, W Lafayette, IN 47907 USA
基金
美国国家科学基金会;
关键词
Feature extraction; Object detection; Head; Agriculture; Neck; Deep learning; Transfer learning; CenterNet; SimAM attention module; small tassel detection; transfer learning; YOLOv5; OBJECT DETECTION; NEURAL-NETWORK;
D O I
10.1109/JSTARS.2022.3206399
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Unmanned aerial vehicles (UAVs) equipped with lightweight sensors, such as RGB cameras and LiDAR, have significant potential in precision agriculture, including object detection. Tassel detection in maize is an essential trait given its relevance as the beginning of the reproductive stage of growth and development of the plants. However, compared with general object detection, tassel detection based on RGB imagery acquired by UAVs is more challenging due to the small size, time-dependent variable shape, and complexity of the objects of interest. A novel algorithm referred to as YOLOv5-tassel is proposed to detect tassels in UAV-based RGB imagery. A bidirectional feature pyramid network is adopted for the path-aggregation neck to effectively fuse cross-scale features. The robust attention module of SimAM is introduced to extract the features of interest before each detection head. An additional detection head is also introduced to improve small-size tassel detection based on the original YOLOv5. Annotation is performed with guidance from center points derived from CenterNet to improve the selection of the bounding boxes for tassels. Finally, to address the issue of limited reference data, transfer learning based on the VisDrone dataset is adopted. Testing results for our proposed YOLOv5-tassel method achieved the mAP value of 44.7%, which is better than well-known object detection approaches, such as FCOS, RetinaNet, and YOLOv5.
引用
收藏
页码:8085 / 8094
页数:10
相关论文
共 66 条
[1]   Assessing winter wheat foliage disease severity using aerial imagery acquired from small Unmanned Aerial Vehicle (UAV) [J].
Bhandari, Mahendra ;
Ibrahim, Amir M. H. ;
Xue, Qingwu ;
Jung, Jinha ;
Chang, Anjin ;
Rudd, Jackie C. ;
Maeda, Murilo ;
Rajan, Nithya ;
Neely, Haly ;
Landivar, Juan .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2020, 176
[2]  
Bochkovskiy A, 2020, Arxiv, DOI arXiv:2004.10934
[3]   PANICLE COUNTING IN UAV IMAGES FOR ESTIMATING FLOWERING TIME IN SORGHUM [J].
Cai, Enyu ;
Baireddy, Sriram ;
Yang, Changye ;
Crawford, Melba ;
Delp, Edward J. .
2021 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM IGARSS, 2021, :6280-6283
[4]   Cascade R-CNN: Delving into High Quality Object Detection [J].
Cai, Zhaowei ;
Vasconcelos, Nuno .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :6154-6162
[5]   Fusion-Based Feature Attention Gate Component for Vehicle Detection Based on Event Camera [J].
Cao, Hu ;
Chen, Guang ;
Xia, Jiahao ;
Zhuang, Genghang ;
Knoll, Alois .
IEEE SENSORS JOURNAL, 2021, 21 (21) :24540-24548
[6]   A Survey of the Four Pillars for Small Object Detection: Multiscale Representation, Contextual Information, Super-Resolution, and Region Proposal [J].
Chen, Guang ;
Wang, Haitao ;
Chen, Kai ;
Li, Zhijun ;
Song, Zida ;
Liu, Yinlong ;
Chen, Wenkai ;
Knoll, Alois .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2022, 52 (02) :936-953
[7]   Event-Based Neuromorphic Vision for Autonomous Driving: A Paradigm Shift for Bio-Inspired Visual Sensing and Perception [J].
Chen, Guang ;
Cao, Hu ;
Conradt, Jorg ;
Tang, Huajin ;
Rohrbein, Florian ;
Knoll, Alois .
IEEE SIGNAL PROCESSING MAGAZINE, 2020, 37 (04) :34-49
[8]  
Chen K, 2019, Arxiv, DOI [arXiv:1906.07155, 10.48550/arXiv.1906.07155, DOI 10.48550/ARXIV.1906.07155]
[9]   You Only Look One-level Feature [J].
Chen, Qiang ;
Wang, Yingming ;
Yang, Tong ;
Zhang, Xiangyu ;
Cheng, Jian ;
Sun, Jian .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :13034-13043
[10]   Adversarial scale-adaptive neural network for crowd counting [J].
Chen, Xinyue ;
Yan, Hua ;
Li, Tong ;
Xu, Jialang ;
Zhu, Fushun .
NEUROCOMPUTING, 2021, 450 :14-24