Instance Segmentation of Underwater Images by Using Deep Learning

被引:0
作者
Chen, Jianfeng [1 ]
Zhu, Shidong [2 ]
Luo, Weilin [2 ]
机构
[1] Xiamen Univ, Pen Tung Sah Inst Micronano Sci & Technol, Xiamen 361102, Peoples R China
[2] Fuzhou Univ, Coll Mech Engn & Automat, Fuzhou 350108, Peoples R China
关键词
underwater image; deep learning; instance segmentation; image enhancement; data augmentation; ADAPTIVE HISTOGRAM EQUALIZATION; CONTRAST; ENHANCEMENT; VEHICLE;
D O I
10.3390/electronics13020274
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Based on deep learning, an underwater image instance segmentation method is proposed. Firstly, in view of the scarcity of underwater related data sets, the size of the data set is expanded by measures including image rotation and flipping, and image generation by a generative adversarial network (GAN). Next, the underwater image data set is finally constructed by manual labeling. Then, in order to solve the problems of color shift, blur and the poor contrast of optical images caused by the complex underwater environment and the attenuation and scattering of light, an underwater image enhancement algorithm is used to first preprocess the data set, and several algorithms are discussed, including multi-scale Retinex (MSRCR) with color recovery, integrated color model (ICM), relative global histogram stretching (RGHS) and unsupervised color correction (UCM), as well as the color shift removal proposed in this work. Specifically, the results indicate that the proposed method can largely increase the segmentation mAP (mean average precision) by 85.7% compared with without the pretreatment method. In addition, based on the characteristics of the constructed underwater dataset, the feature pyramid network (FPN) is improved to some extent, and the preprocessing method is further combined with the improved network for experiments and compared with other neural networks to verify the effectiveness of the proposed method, thus achieving the effect and purpose of improving underwater image instance segmentation and target recognition. The experimental analysis results show that the proposed model can achieve a mAP of 0.245, which is about 1.1 times higher than other target recognition models.
引用
收藏
页数:25
相关论文
共 51 条
  • [1] Ahn J, 2017, J MAR SCI TECH-JAPAN, V22, P758, DOI 10.1007/s00773-017-0442-1
  • [2] Barnard K., 1999, Color Imaging in Multimedia, P9
  • [3] Color corrected single scale retinex based haze removal and color correction for underwater images
    Bindhu, A.
    Maheswari, Uma O.
    [J]. COLOR RESEARCH AND APPLICATION, 2020, 45 (06) : 1084 - 1093
  • [4] YOLACT Real-time Instance Segmentation
    Bolya, Daniel
    Zhou, Chong
    Xiao, Fanyi
    Lee, Yong Jae
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 9156 - 9165
  • [5] Cai Y., 2009, Laser J, V49-50, P52
  • [6] Cao J., 2022, Comput. Syst. Appl, V31, P309
  • [7] [陈瀚 Chen Han], 2022, [大连海事大学学报, Journal of Dalian Maritime University], V48, P95
  • [8] DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs
    Chen, Liang-Chieh
    Papandreou, George
    Kokkinos, Iasonas
    Murphy, Kevin
    Yuille, Alan L.
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) : 834 - 848
  • [9] Instance-Sensitive Fully Convolutional Networks
    Dai, Jifeng
    He, Kaiming
    Li, Yi
    Ren, Shaoqing
    Sun, Jian
    [J]. COMPUTER VISION - ECCV 2016, PT VI, 2016, 9910 : 534 - 549
  • [10] Fisher Y., 2017, P IEEE C COMPUTER VI, P636, DOI DOI 10.1109/CVPR.2017.75