Multiscale Maize Tassel Identification Based on Improved RetinaNet Model and UAV Images

被引:11
作者
Wang, Binbin [1 ,2 ]
Yang, Guijun [1 ]
Yang, Hao [1 ]
Gu, Jinan [2 ]
Xu, Sizhe [1 ]
Zhao, Dan [1 ]
Xu, Bo [1 ,3 ]
机构
[1] Beijing Acad Agr & Forestry Sci, Informat Technol Res Ctr, Minist Agr & Rural Affairs, Key Lab Quantitat Remote Sensing Agr, Beijing 100097, Peoples R China
[2] Jiangsu Univ, Sch Mech Engn, Zhenjiang 212000, Peoples R China
[3] Univ Sci & Technol Beijing, Sch Chem & Bioengn, Beijing 100083, Peoples R China
关键词
deep learning; target detection; maize tassels; UAV; image analysis; VEGETATION INDEXES; CORN; YIELD; CROP; EAR;
D O I
10.3390/rs15102530
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
The acquisition of maize tassel phenotype information plays a vital role in studying maize growth and improving yield. Unfortunately, detecting maize tassels has proven challenging because of the complex field environment, including image resolution, varying sunlight conditions, plant varieties, and planting density. To address this situation, the present study uses unmanned aerial vehicle (UAV) remote sensing technology and a deep learning algorithm to facilitate maize tassel identification and counting. UAVs are used to collect maize tassel images in experimental fields, and RetinaNet serves as the basic model for detecting maize tassels. Small maize tassels are accurately identified by optimizing the feature pyramid structure in the model and introducing attention mechanisms. We also study how mapping differences in image resolution, brightness, plant variety, and planting density affect the RetinaNet model. The results show that the improved RetinaNet model is significantly better at detecting maize tassels than the original RetinaNet model. The average precision in this study is 0.9717, the precision is 0.9802, and the recall rate is 0.9036. Compared with the original model, the improved RetinaNet improves the average precision, precision, and recall rate by 1.84%, 1.57%, and 4.6%, respectively. Compared with mainstream target detection models such as Faster R-CNN, YOLOX, and SSD, the improved RetinaNet model more accurately detects smaller maize tassels. For equal-area images of differing resolution, maize tassel detection becomes progressively worse as the resolution decreases. We also analyze how detection depends on brightness in the various models. With increasing image brightness, the maize tassel detection worsens, especially for small maize tassels. This paper also analyzes the various models for detecting the tassels of five maize varieties. Zhengdan958 tassels prove the easiest to detect, with R-2 = 0.9708, 0.9759, and 0.9545 on 5, 9, and 20 August 2021, respectively. Finally, we use the various models to detect maize tassels under different planting densities. At 29,985, 44,978, 67,466, and 89,955 plants/hm(2), the mean absolute errors for detecting Zhengdan958 tassels are 0.18, 0.26, 0.48, and 0.63, respectively. Thus, the detection error increases gradually with increasing planting density. This study thus provides a new method for high-precision identification of maize tassels in farmland and is especially useful for detecting small maize tassels. This technology can be used for high-throughput investigations of maize phenotypic traits.
引用
收藏
页数:21
相关论文
共 52 条
  • [1] Amit Y., 2020, Computer Vision: A Reference Guide, P1, DOI DOI 10.1007/978-3-030-03243-2_660-1
  • [2] Bochkovskiy A, 2020, Arxiv, DOI [arXiv:2004.10934, 10.48550/arXiv.2004.10934, DOI 10.48550/ARXIV.2004.10934]
  • [3] Forecasting crop yield using remotely sensed vegetation indices and crop phenology metrics
    Bolton, Douglas K.
    Friedl, Mark A.
    [J]. AGRICULTURAL AND FOREST METEOROLOGY, 2013, 173 : 74 - 84
  • [4] Integer-based accurate conversion between RGB and HSV color spaces
    Chemov, Vladimir
    Alander, Jarmo
    Bochko, Vladimir
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2015, 46 : 328 - 337
  • [5] Research on Recognition of Fly Species Based on Improved RetinaNet and CBAM
    Chen, Yantong
    Zhang, Xianzhong
    Chen, Weinan
    Li, Yuyang
    Wang, Junsheng
    [J]. IEEE ACCESS, 2020, 8 (08) : 102907 - 102919
  • [6] An effective infrared small target detection method based on the human visual attention
    Chen, Yuwen
    Song, Bin
    Wang, Dianjun
    Guo, Linghua
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2018, 95 : 128 - 135
  • [7] Deep Learning: Methods and Applications
    Deng, Li
    Yu, Dong
    [J]. FOUNDATIONS AND TRENDS IN SIGNAL PROCESSING, 2013, 7 (3-4): : I - 387
  • [8] Review on the Technological Development and Application of UAV Systems
    Fan, Bangkui
    Li, Yun
    Zhang, Ruiyu
    Fu, Qiqi
    [J]. CHINESE JOURNAL OF ELECTRONICS, 2020, 29 (02) : 199 - 207
  • [9] TIPS: a system for automated image-based phenotyping of maize tassels
    Gage, Joseph L.
    Miller, Nathan D.
    Spalding, Edgar P.
    Kaeppler, Shawn M.
    de Leon, Natalia
    [J]. PLANT METHODS, 2017, 13
  • [10] Ge Z, 2021, Arxiv, DOI arXiv:2107.08430