Determining Strawberries' Varying Maturity Levels by Utilizing Image Segmentation Methods of Improved DeepLabV3+

被引:16
作者
Cai, Changqing [1 ,2 ]
Tan, Jianwen [3 ]
Zhang, Peisen [4 ]
Ye, Yuxin [5 ]
Zhang, Jian [6 ,7 ]
机构
[1] Engn Training Ctr, Changchun Inst Technol, Changchun 130012, Peoples R China
[2] Natl & Local Joint Engn Res Ctr Smart Distribut N, Changchun 130012, Peoples R China
[3] Changchun Inst Technol, Coll Elect & Informat Engn, Changchun 130012, Peoples R China
[4] Changchun Inst Technol, Coll Energy & Power Engn, Changchun 130012, Peoples R China
[5] Jilin Univ, Coll Comp Sci & Technol, Changchun 130012, Peoples R China
[6] Jilin Agr Univ, Fac Agron, Changchun 130018, Peoples R China
[7] Univ British Columbia, Dept Biol, Kelowna, BC V1V 1V7, Canada
来源
AGRONOMY-BASEL | 2022年 / 12卷 / 08期
关键词
improved DeepLabV3+; attention mechanism; image segmentation; strawberry; FRUIT; LOCALIZATION; BRANCHES;
D O I
10.3390/agronomy12081875
中图分类号
S3 [农学(农艺学)];
学科分类号
0901 ;
摘要
Aiming to determine the inaccurate image segmentation of strawberries with varying maturity levels due to fruit adhesion and stacking, this study proposed a strawberry image segmentation method based on the improved DeepLabV3+ model. The technique introduced the attention mechanism into the backbone network and the atrous spatial pyramid pooling module of the DeepLabV3+ network, adjusted the weights of feature channels in the neural network propagation process through the attention mechanism to enhance the feature information of strawberry images, reduced the interference of environmental factors, and improved the accuracy of strawberry image segmentation. The experimental results showed that the proposed method can accurately segment images of strawberries with different maturities; the mean pixel accuracy and mean intersection over union of the model were 90.9% and 83.05%, respectively, and the frames per second (FPS) was 7.67. The method can effectively reduce the influence of environmental factors on strawberry image segmentation and provide an effective approach for accurate operation of strawberry picking robots.
引用
收藏
页数:15
相关论文
共 37 条
  • [1] An Instance Segmentation Model for Strawberry Diseases Based on Mask R-CNN
    Afzaal, Usman
    Bhattarai, Bhuwan
    Pandeya, Yagya Raj
    Lee, Joonwhoan
    [J]. SENSORS, 2021, 21 (19)
  • [2] [陈进 Chen Jin], 2020, [农业工程学报, Transactions of the Chinese Society of Agricultural Engineering], V36, P174
  • [3] Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
    Chen, Liang-Chieh
    Zhu, Yukun
    Papandreou, George
    Schroff, Florian
    Adam, Hartwig
    [J]. COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 : 833 - 851
  • [4] Chen LB, 2017, IEEE INT SYMP NANO, P1, DOI 10.1109/NANOARCH.2017.8053709
  • [5] Segmentation of field grape bunches via an improved pyramid scene parsing network
    Chen, Shan
    Song, Yuyang
    Su, Jinya
    Fang, Yulin
    Shen, Lei
    Mi, Zhiwen
    Su, Baofeng
    [J]. INTERNATIONAL JOURNAL OF AGRICULTURAL AND BIOLOGICAL ENGINEERING, 2021, 14 (06) : 185 - 194
  • [6] Counting Apples and Oranges With Deep Learning: A Data-Driven Approach
    Chen, Steven W.
    Shivakumar, Shreyas S.
    Dcunha, Sandeep
    Das, Jnaneshwar
    Okon, Edidiong
    Qu, Chao
    Taylor, Camillo J.
    Kumar, Vijay
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2017, 2 (02): : 781 - 788
  • [7] Xception: Deep Learning with Depthwise Separable Convolutions
    Chollet, Francois
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1800 - 1807
  • [8] Instance Segmentation and Localization of Strawberries in Farm Conditions for Automatic Fruit Harvesting
    Ge, Yuanyue
    Xiong, Ya
    From, Pal J.
    [J]. IFAC PAPERSONLINE, 2019, 52 (30): : 294 - 299
  • [9] Deep learning for visual understanding: A review
    Guo, Yanming
    Liu, Yu
    Oerlemans, Ard
    Lao, Songyang
    Wu, Song
    Lew, Michael S.
    [J]. NEUROCOMPUTING, 2016, 187 : 27 - 48
  • [10] Multi-Scale Context Aggregation for Strawberry Fruit Recognition and Disease Phenotyping
    Ilyas, Talha
    Khan, Abbas
    Umraiz, Muhammad
    Jeong, Yongchae
    Kim, Hyongsuk
    [J]. IEEE ACCESS, 2021, 9 : 124491 - 124504