Meta-learning based infrared ship object detection model for generalization to unknown domains

被引:4
作者
Feng, Hui [1 ,2 ]
Tang, Wei [1 ,2 ]
Xu, Haixiang [1 ,2 ]
Jiang, Chengxin [1 ,2 ]
Ge, Shuzhi Sam [3 ]
He, Jianhua [4 ]
机构
[1] Wuhan Univ Technol, Key Lab High Performance Ship Technol, Minist Educ, Wuhan 430063, Peoples R China
[2] Wuhan Univ Technol, Sch Naval Architecture Ocean & Energy Power Engn, Wuhan 430063, Peoples R China
[3] Natl Univ Singapore, Dept Elect & Comp Engn, Singapore 117576, Singapore
[4] Univ Essex, Sch Comp Sci & Elect Engn, Colchester CO4 3SQ, England
基金
中国国家自然科学基金; 英国工程与自然科学研究理事会;
关键词
Infrared object detection; Meta-learning; Domain discriminator; Intelligent ship; ALIGNMENT;
D O I
10.1016/j.asoc.2024.111633
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Infrared images exhibit considerable variations in probability distributions, stemming from the utilization of distinct infrared sensors and the influence of diverse environmental conditions. The variations pose great challenges for deep learning models to detect ship objects and adapt to unseen maritime environments. To address the domain shift problem, we propose an end -to -end infrared ship object detection model based on meta -learning neural network to improve domain adaptation for target domain where data is not available at training phase. Different from existing domain generalization methods, the novelty of our model lies in the effective exploitation of meta -learning and domain adaptation, ensuring that the extracted domain -independent features are meaningful and domain -invariant at the semantic level. Firstly, a double gradient -based metalearning algorithm is designed to solve the common optimal descent direction between different domains through two gradient updates in the inner and outer loops. The algorithm enables extraction of domaininvariant features from the pseudo -source and pseudo -target domain data. Secondly, a domain discriminator with dynamic -weighted gradient reversal layer (DWGRL) is designed to accurately classify domain -invariant features and provide additional global supervision information. Finally, a multi -scale feature aggregation method is proposed to improve the extraction of multi -scale domain -invariant features. It can effectively fuse local features at different scales and global features of targets. Extensive experimental results conducted in real nighttime water surface scenes demonstrate that the proposed model achieves very high detection accuracy on target domain data, even no target domain data was used during the training phase. Compared to the existing methods, our method not only improves the detection accuracy of infrared ships by 18%, but also exhibits the smallest standard deviation with a value of 0.93, indicating its superior generalization performance.
引用
收藏
页数:13
相关论文
共 53 条
[1]  
Albuquerque I., 2019, arXiv
[2]   Feature based fuzzy inference system for segmentation of low-contrast infrared ship images [J].
Bai, Xiangzhi ;
Liu, Miaoming ;
Wang, Tao ;
Chen, Zhiguo ;
Wang, Peng ;
Zhang, Yu .
APPLIED SOFT COMPUTING, 2016, 46 :128-142
[3]  
Balaji Y, 2018, ADV NEUR IN, V31
[4]   STDnet: Exploiting high resolution feature maps for small object detection [J].
Bosquet, Brais ;
Mucientes, Manuel ;
Brea, Victor M. .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2020, 91
[5]   Domain Generalization by Solving Jigsaw Puzzles [J].
Carlucci, Fabio M. ;
D'Innocente, Antonio ;
Bucci, Silvia ;
Caputo, Barbara ;
Tommasi, Tatiana .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :2224-2233
[6]   A knowledge-free path planning approach for smart ships based on reinforcement learning [J].
Chen, Chen ;
Chen, Xian-Qiao ;
Ma, Feng ;
Zeng, Xiao-Jun ;
Wang, Jin .
OCEAN ENGINEERING, 2019, 189
[7]   Typical Target Detection for Infrared Homing Guidance Based on YOLO v3 [J].
Chen Tieming ;
Fu Guangyuan ;
Li Shiyi ;
Li Yuan .
LASER & OPTOELECTRONICS PROGRESS, 2019, 56 (16)
[8]  
Chen XY, 2019, PR MACH LEARN RES, V97
[9]   Domain Adaptive Faster R-CNN for Object Detection in the Wild [J].
Chen, Yuhua ;
Li, Wen ;
Sakaridis, Christos ;
Dai, Dengxin ;
Van Gool, Luc .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :3339-3348
[10]   Weak and Occluded Vehicle Detection in Complex Infrared Environment Based on Improved YOLOv4 [J].
Du, Shuangjiang ;
Zhang, Pin ;
Zhang, Baofu ;
Xu, Honghui .
IEEE ACCESS, 2021, 9 :25671-25680