KCPNet: Knowledge-Driven Context Perception Networks for Ship Detection in Infrared Imagery

被引:46
作者
Han, Yaqi [1 ,2 ]
Liao, Jingwen [1 ,2 ]
Lu, Tianshu [1 ,2 ]
Pu, Tian [1 ,2 ]
Peng, Zhenming [1 ,2 ]
机构
[1] Univ Elect Sci & Technol China, Sch Informat & Commun Engn, Chengdu 610054, Peoples R China
[2] Univ Elect Sci & Technol China, Lab Imaging Detect & Intelligent Percept, Chengdu 610054, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2023年 / 61卷
基金
中国国家自然科学基金;
关键词
Complex ocean environment; contextual information; infrared ship detection dataset (ISDD); knowledge-driven network; receptive field; TARGET DETECTION; SALIENCY;
D O I
10.1109/TGRS.2022.3233401
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Ship detection plays a crucial role in a variety of military and civilian marine inspection applications. Infrared images are irreplaceable data sources for ship detection due to their strong adaptability and excellent all-weather reconnaissance ability. However, previous researches mainly focus on visible light or synthetic aperture radar (SAR) ship detection, while infrared ship detection is left in a huge blind spot. The main obstacles to this dilemma lie in the absence of public datasets, small scale, and poor semantic information of infrared ships, and severe clutter in complex ocean environments. To address the above challenges, we propose a knowledge-driven context perception network (KCPNet) and construct a public dataset called infrared ship detection dataset (ISDD). In KCPNet, aiming at the small scale of infrared ships, a balanced feature fusion network (BFF-Net) is proposed to balance information from all backbone layers and generate nonlocal features with balanced receptive fields. Moreover, considering the key role of contextual information, a contextual attention network (CA-Net) is designed to improve robustness in complex scenes by enhancing target and contextual information and suppressing clutter. Inspired by prior knowledge of human cognitive processes, we construct a novel knowledge-driven prediction head to autonomously learn visual features and back-propagate the knowledge throughout the whole network, which can efficiently reduce false alarms. Extensive experiments demonstrate that the proposed KCPNet achieves state-of-the-art performance on ISDD. Source codes and ISDD are accessible at https://github.com/yaqihan-9898.
引用
收藏
页数:19
相关论文
共 60 条
[41]   FCOS: Fully Convolutional One-Stage Object Detection [J].
Tian, Zhi ;
Shen, Chunhua ;
Chen, Hao ;
He, Tong .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :9626-9635
[42]   Focal Loss for Dense Object Detection [J].
Lin, Tsung-Yi ;
Goyal, Priya ;
Girshick, Ross ;
He, Kaiming ;
Dollar, Piotr .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :2999-3007
[43]  
Wang G., 2021, IEEE T GEOSCI ELECT, V60
[44]   A method for land surface temperature retrieval based on model-data-knowledge-driven and deep learning [J].
Wang, Han ;
Mao, Kebiao ;
Yuan, Zijin ;
Shi, Jiancheng ;
Cao, Mengmeng ;
Qin, Zhihao ;
Duan, Sibo ;
Tang, Bohui .
REMOTE SENSING OF ENVIRONMENT, 2021, 265 (265)
[45]   Hard exudate detection based on deep model learned information and multi-feature joint representation for diabetic retinopathy screening [J].
Wang, Hui ;
Yuan, Guohui ;
Zhao, Xuegong ;
Peng, Lingbing ;
Wang, Zhuoran ;
He, Yanmin ;
Qu, Chao ;
Peng, Zhenming .
COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2020, 191
[46]   Ship Detection in Spaceborne Infrared Image Based on Lightweight CNN and Multisource Feature Cascade Decision [J].
Wang, Nan ;
Li, Bo ;
Wei, Xingxing ;
Wang, Yonghua ;
Yan, Huanqian .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (05) :4324-4339
[47]   Understanding Convolution for Semantic Segmentation [J].
Wang, Panqu ;
Chen, Pengfei ;
Yuan, Ye ;
Liu, Ding ;
Huang, Zehua ;
Hou, Xiaodi ;
Cottrell, Garrison .
2018 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2018), 2018, :1451-1460
[48]   Efficient and Accurate Arbitrary-Shaped Text Detection with Pixel Aggregation Network [J].
Wang, Wenhai ;
Xie, Enze ;
Song, Xiaoge ;
Zang, Yuhang ;
Wang, Wenjia ;
Lu, Tong ;
Yu, Gang ;
Shen, Chunhua .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :8439-8448
[49]   Non-local Neural Networks [J].
Wang, Xiaolong ;
Girshick, Ross ;
Gupta, Abhinav ;
He, Kaiming .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :7794-7803
[50]   Multiscale patch-based contrast measure for small infrared target detection [J].
Wei, Yantao ;
You, Xinge ;
Li, Hong .
PATTERN RECOGNITION, 2016, 58 :216-226