Personnel Detection in Dark Aquatic Environments Based on Infrared Thermal Imaging Technology and an Improved YOLOv5s Model

被引:7
作者
Cheng, Liang [1 ,2 ]
He, Yunze [3 ]
Mao, Yankai [3 ]
Liu, Zhenkang [3 ]
Dang, Xiangzhao [3 ]
Dong, Yilong [3 ]
Wu, Liangliang [3 ]
机构
[1] Jiangsu Ocean Univ, Sch Ocean Engn, Lianyungang 222005, Peoples R China
[2] Zhuhai Yunzhou Intelligence Technol Co Ltd, Zhuhai 519085, Peoples R China
[3] Hunan Univ, Coll Elect & Informat Engn, Changsha 410082, Peoples R China
关键词
infrared thermal image; object detection; intelligent rescue; YOLO; OBJECT DETECTION; CLASSIFICATION;
D O I
10.3390/s24113321
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This study presents a novel method for the nighttime detection of waterborne individuals using an enhanced YOLOv5s algorithm tailored for infrared thermal imaging. To address the unique challenges of nighttime water rescue operations, we have constructed a specialized dataset comprising 5736 thermal images collected from diverse aquatic environments. This dataset was further expanded through synthetic image generation using CycleGAN and a newly developed color gamut transformation technique, which significantly improves the data variance and model training effectiveness. Furthermore, we integrated the Convolutional Block Attention Module (CBAM) at the end of the last encoder's feedforward network. This integration maximizes the utilization of channel and spatial information to capture more intricate details in the feature maps. To decrease the computational demands of the network while maintaining model accuracy, Ghost convolution was employed, thereby boosting the inference speed as much as possible. Additionally, we applied hyperparameter evolution to refine the training parameters. The improved algorithm achieved an average detection accuracy of 85.49% on our proprietary dataset, significantly outperforming its predecessor, with a prediction speed of 23.51 FPS. The experimental outcomes demonstrate the proposed solution's high recognition capabilities and robustness, fulfilling the demands of intelligent lifesaving missions.
引用
收藏
页数:14
相关论文
共 25 条
[1]   Pedestrian Detection from Thermal Images Incorporating Saliency Features [J].
Altay, Fatih ;
Velipasalar, Senem .
2020 54TH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2020, :1548-1552
[2]   Deep Learning-Based Thermal Image Reconstruction and Object Detection [J].
Batchuluun, Ganbayar ;
Kang, Jin Kyu ;
Nguyen, Dat Tien ;
Pham, Tuyen Danh ;
Arsalan, Muhammad ;
Park, Kang Ryoung .
IEEE ACCESS, 2021, 9 :5951-5971
[3]  
Bochkovskiy A, 2020, Arxiv, DOI [arXiv:2004.10934, 10.48550/arXiv.2004.10934]
[4]   Water Target Recognition Method and Application for Unmanned Surface Vessels [J].
Cheng, Liang ;
Deng, Baoyuan ;
Yang, Yuan ;
Lyu, Jifang ;
Zhao, Jicheng ;
Zhou, Ke ;
Yang, Chunli ;
Wang, Leigang ;
Yang, Shiyuan ;
He, Yunze .
IEEE ACCESS, 2022, 10 :421-434
[5]   Evaluation of Thermal Imaging on Embedded GPU Platforms for Application in Vehicular Assistance Systems [J].
Farooq, Muhammad Ali ;
Shariff, Waseem ;
Corcoran, Peter .
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (02) :1130-1144
[6]   GhostNet: More Features from Cheap Operations [J].
Han, Kai ;
Wang, Yunhe ;
Tian, Qi ;
Guo, Jianyuan ;
Xu, Chunjing ;
Xu, Chang .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :1577-1586
[7]   Classification of EEG signals using the wavelet transform [J].
Hazarika, N ;
Chen, JZ ;
Tsoi, AC ;
Sergejew, A .
SIGNAL PROCESSING, 1997, 59 (01) :61-72
[8]   Infrared machine vision and infrared thermography with deep learning: A review [J].
He, Yunze ;
Deng, Baoyuan ;
Wang, Hongjin ;
Cheng, Liang ;
Zhou, Ke ;
Cai, Siyuan ;
Ciampa, Francesco .
INFRARED PHYSICS & TECHNOLOGY, 2021, 116
[9]   RDNet: Regression Dense and Attention for Object Detection in Traffic Symbols [J].
Hong, Feng ;
Lu, Changhua ;
Jiang, Weiwei ;
Ju, Wei ;
Wang, Tao .
IEEE SENSORS JOURNAL, 2021, 21 (22) :25372-25378
[10]   YOLOv3-DPFIN: A Dual-Path Feature Fusion Neural Network for Robust Real-Time Sonar Target Detection [J].
Kong, Wanzeng ;
Hong, Jichen ;
Jia, Mingyang ;
Yao, Jinliang ;
Gong, Weihua ;
Hu, Hua ;
Zhang, Haigang .
IEEE SENSORS JOURNAL, 2020, 20 (07) :3745-3756