Determining Strawberries' Varying Maturity Levels by Utilizing Image Segmentation Methods of Improved DeepLabV3+

被引:20
作者
Cai, Changqing [1 ,2 ]
Tan, Jianwen [3 ]
Zhang, Peisen [4 ]
Ye, Yuxin [5 ]
Zhang, Jian [6 ,7 ]
机构
[1] Engn Training Ctr, Changchun Inst Technol, Changchun 130012, Peoples R China
[2] Natl & Local Joint Engn Res Ctr Smart Distribut N, Changchun 130012, Peoples R China
[3] Changchun Inst Technol, Coll Elect & Informat Engn, Changchun 130012, Peoples R China
[4] Changchun Inst Technol, Coll Energy & Power Engn, Changchun 130012, Peoples R China
[5] Jilin Univ, Coll Comp Sci & Technol, Changchun 130012, Peoples R China
[6] Jilin Agr Univ, Fac Agron, Changchun 130018, Peoples R China
[7] Univ British Columbia, Dept Biol, Kelowna, BC V1V 1V7, Canada
来源
AGRONOMY-BASEL | 2022年 / 12卷 / 08期
关键词
improved DeepLabV3+; attention mechanism; image segmentation; strawberry; FRUIT; LOCALIZATION; BRANCHES;
D O I
10.3390/agronomy12081875
中图分类号
S3 [农学(农艺学)];
学科分类号
0901 ;
摘要
Aiming to determine the inaccurate image segmentation of strawberries with varying maturity levels due to fruit adhesion and stacking, this study proposed a strawberry image segmentation method based on the improved DeepLabV3+ model. The technique introduced the attention mechanism into the backbone network and the atrous spatial pyramid pooling module of the DeepLabV3+ network, adjusted the weights of feature channels in the neural network propagation process through the attention mechanism to enhance the feature information of strawberry images, reduced the interference of environmental factors, and improved the accuracy of strawberry image segmentation. The experimental results showed that the proposed method can accurately segment images of strawberries with different maturities; the mean pixel accuracy and mean intersection over union of the model were 90.9% and 83.05%, respectively, and the frames per second (FPS) was 7.67. The method can effectively reduce the influence of environmental factors on strawberry image segmentation and provide an effective approach for accurate operation of strawberry picking robots.
引用
收藏
页数:15
相关论文
共 37 条
[1]   An Instance Segmentation Model for Strawberry Diseases Based on Mask R-CNN [J].
Afzaal, Usman ;
Bhattarai, Bhuwan ;
Pandeya, Yagya Raj ;
Lee, Joonwhoan .
SENSORS, 2021, 21 (19)
[2]  
[陈进 Chen Jin], 2020, [农业工程学报, Transactions of the Chinese Society of Agricultural Engineering], V36, P174
[3]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[4]  
Chen LB, 2017, IEEE INT SYMP NANO, P1, DOI 10.1109/NANOARCH.2017.8053709
[5]   Segmentation of field grape bunches via an improved pyramid scene parsing network [J].
Chen, Shan ;
Song, Yuyang ;
Su, Jinya ;
Fang, Yulin ;
Shen, Lei ;
Mi, Zhiwen ;
Su, Baofeng .
INTERNATIONAL JOURNAL OF AGRICULTURAL AND BIOLOGICAL ENGINEERING, 2021, 14 (06) :185-194
[6]   Counting Apples and Oranges With Deep Learning: A Data-Driven Approach [J].
Chen, Steven W. ;
Shivakumar, Shreyas S. ;
Dcunha, Sandeep ;
Das, Jnaneshwar ;
Okon, Edidiong ;
Qu, Chao ;
Taylor, Camillo J. ;
Kumar, Vijay .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2017, 2 (02) :781-788
[7]   Xception: Deep Learning with Depthwise Separable Convolutions [J].
Chollet, Francois .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1800-1807
[8]   Instance Segmentation and Localization of Strawberries in Farm Conditions for Automatic Fruit Harvesting [J].
Ge, Yuanyue ;
Xiong, Ya ;
From, Pal J. .
IFAC PAPERSONLINE, 2019, 52 (30) :294-299
[9]   Deep learning for visual understanding: A review [J].
Guo, Yanming ;
Liu, Yu ;
Oerlemans, Ard ;
Lao, Songyang ;
Wu, Song ;
Lew, Michael S. .
NEUROCOMPUTING, 2016, 187 :27-48
[10]   Multi-Scale Context Aggregation for Strawberry Fruit Recognition and Disease Phenotyping [J].
Ilyas, Talha ;
Khan, Abbas ;
Umraiz, Muhammad ;
Jeong, Yongchae ;
Kim, Hyongsuk .
IEEE ACCESS, 2021, 9 :124491-124504