Semantic segmentation model of cotton roots in-situ image based on attention mechanism

被引:64
作者
Kang, Jia [1 ]
Liu, Liantao [2 ,3 ,4 ]
Zhang, Fucheng [5 ]
Shen, Chen [1 ]
Wang, Nan [1 ,2 ]
Shao, Limin [1 ]
机构
[1] Hebei Agr Univ, Coll Mech & Elect Engn, Baoding 071001, Peoples R China
[2] State Key Lab North China Crop Improvement & Regu, Baoding 071001, Peoples R China
[3] Key Lab Crop Growth Regulat Hebei Prov, Baoding 071001, Peoples R China
[4] Hebei Agr Univ, Coll Agron, Baoding 071001, Peoples R China
[5] Hebei Agr Univ, Coll Informat Sci & Technol, Baoding 071001, Peoples R China
基金
中国国家自然科学基金;
关键词
Attention mechanism; DeepLabv3+; Cotton root system; Semantic segmentation;
D O I
10.1016/j.compag.2021.106370
中图分类号
S [农业科学];
学科分类号
09 ;
摘要
The growth and distribution of root system in the soil has an important influence on the growth of plants and is one of the important factors affecting crop production. However, the root system of plants is located in the dark and closed soil. Even if we can obtain high-definition root image from the complex soils, the interference of the soil particles on root system and the small difference of color between them will pose challenges for further root segmentation. In this experiment, the cotton mature root system is used as the research object. Based on the introduction of sub-pixel convolution DeepLabv3+ semantic segmentation model, we further added the attention mechanism to the model, assigning more weight to the pixel points of fine roots and their root hairs, and designed a semantic segmentation model of cotton roots in-situ image based on the attention mechanism. The experimental results show that the model has higher segmentation accuracy and operational efficiency than only introduces sub-pixel convolution DeepLabv3+ model, U-Net model and SegNet model. The precision value, recall value and F1-score are 0.9971, 0.9984 and 0.9937 respectively, and the IoU value of 161 untrained root image segmentation tasks was 0.9875. At the same time, we also performed segmentation experiments on the early cotton root images. The results show that the DeepLabv3+ model which only introduces sub-pixel convolution, U-Net model and SegNet model have poor segmentation effects. The semantic segmentation model based on attention mechanism proposed in this paper can be segmented accurately. The above results show that the proposed model can distinguish the cotton root system from the complex soil background accurately and has good segmentation effect. It can realize the accurate segmentation of root image in early and mature period in the process of cotton root growth, and provide important theoretical value and practical application reference for deep learning in plant root segmentation.
引用
收藏
页数:11
相关论文
共 36 条
[1]   Leaf Counting with Deep Convolutional and Deconvolutional Networks [J].
Aich, Shubhra ;
Stavness, Ian .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, :2080-2089
[2]  
Atanbori J., 2018, P WORKSH IS HELD 29
[3]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[4]  
Bahdanau D, 2016, Arxiv, DOI arXiv:1409.0473
[5]  
Chollet F., 2016, ARXIV E PRINTS
[6]   Control of goal-directed and stimulus-driven attention in the brain [J].
Corbetta, M ;
Shulman, GL .
NATURE REVIEWS NEUROSCIENCE, 2002, 3 (03) :201-215
[7]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[8]  
GOODWIN RICHARD H., 1948, BULL TORREY BOT CLUB, V75, P1, DOI 10.2307/2482135
[9]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[10]   A model of saliency-based visual attention for rapid scene analysis [J].
Itti, L ;
Koch, C ;
Niebur, E .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1998, 20 (11) :1254-1259