GOMT: Multispectral video tracking based on genetic optimization and multi-features integration

被引:7
作者
Qian, Kun [1 ]
Chen, Peng [1 ]
Zhao, Dong [2 ]
机构
[1] Jiangnan Univ, Sch Artificial Intelligence & Comp Sci, 1800 Lihu Rd, Wuxi 214122, Jiangsu, Peoples R China
[2] Wuxi Univ, Sch Elect Informat Engn, Wuxi, Jiangsu, Peoples R China
关键词
computer vision; correlation methods; fast Fourier transforms; feature extraction; feature selection; image classification; image fusion; TARGET TRACKING; NETWORK;
D O I
10.1049/ipr2.12739
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Traditional visual tracking algorithms on RGB cannot effectively distinguish an object from background with similar colour feature, resulting in the migration problem in the tracking process. In order to solve this problem, a tracking algorithm with spectral information is proposed by using band selection, information fusion, and deep features. Firstly, the correlation analysis of 16 spectral band information is carried out, and genetic optimization method is introduced to obtain two bands with low correlation coefficient and abundant information. Moreover, under the framework of kernel correlation filtering tracking, guided filtering is adopted to fuse the information referring to the target region of the two bands. Besides, the feature maps are generated by histogram of gradient and pretrained visual geometry group network. Finally, target is detected via finding the maximum value of a strong response. The proposed genetic optimization based multifeature tracker is compared with multiple tracking methods including correlation filtering and deep learning. Experimental results with multiple groups of spectral videos and corresponding RGB videos demonstrate that the genetic optimization based multifeature tracker method achieves good results in subjective vision and objective evaluation.
引用
收藏
页码:1578 / 1589
页数:12
相关论文
共 50 条
[31]   Multi3: multi-templates siamese network with multi-peaks detection and multi-features refinement for target tracking in ultrasound image sequences [J].
Wang, Yifan ;
Fu, Tianyu ;
Wang, Yan ;
Xiao, Deqiang ;
Lin, Yucong ;
Fan, Jingfan ;
Song, Hong ;
Liu, Fangyi ;
Yang, Jian .
PHYSICS IN MEDICINE AND BIOLOGY, 2022, 67 (19)
[32]   Target Tracking Based on Multi Feature Selection Fusion Compensation in Monitoring Video [J].
Feng, Yingying ;
Zhao, Shasha ;
Liu, Hui .
AUTOMATIC CONTROL AND COMPUTER SCIENCES, 2019, 53 (06) :522-531
[33]   Target Tracking Based on Multi Feature Selection Fusion Compensation in Monitoring Video [J].
Shasha Yingying Feng ;
Hui Zhao .
Automatic Control and Computer Sciences, 2019, 53 :522-531
[34]   A comprehensive hierarchical classification based on multi-features of breast DCE-MRI for cancer diagnosis [J].
Hui Liu ;
Jinke Wang ;
Jiyue Gao ;
Shanshan Liu ;
Xiang Liu ;
Zuowei Zhao ;
Dongmei Guo ;
Guo Dan .
Medical & Biological Engineering & Computing, 2020, 58 :2413-2425
[35]   A transformer-based multi-features fusion model for prediction of conversion in mild cognitive impairment [J].
Zheng, Guowei ;
Zhang, Yu ;
Zhao, Ziyang ;
Wang, Yin ;
Liu, Xia ;
Shang, Yingying ;
Cong, Zhaoyang ;
Dimitriadis, Stavros I. ;
Yao, Zhijun ;
Hu, Bin .
METHODS, 2022, 204 :241-248
[36]   Temporal Multi-Features Representation Learning-Based Clustering for Time-Series Data [J].
Lee, Jaehoon ;
Kim, Dohee ;
Sim, Sunghyun .
IEEE ACCESS, 2024, 12 :87675-87690
[37]   A comprehensive hierarchical classification based on multi-features of breast DCE-MRI for cancer diagnosis [J].
Liu, Hui ;
Wang, Jinke ;
Gao, Jiyue ;
Liu, Shanshan ;
Liu, Xiang ;
Zhao, Zuowei ;
Guo, Dongmei ;
Dan, Guo .
MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2020, 58 (10) :2413-2425
[38]   A Novel Feature Selection and Classification Method of Alzheimer's Disease based on Multi-features in MRI [J].
Luo, Peiqi ;
Kang, Guixia ;
Xu, Xin .
PROCEEDINGS OF 2020 10TH INTERNATIONAL CONFERENCE ON BIOSCIENCE, BIOCHEMISTRY AND BIOINFORMATICS (ICBBB 2020), 2020, :114-119
[39]   A Depth Video-based Human Detection and Activity Recognition using Multi-features and Embedded Hidden Markov Models for Health Care Monitoring Systems [J].
Jalal, Ahmad ;
Kamal, Shaharyar ;
Kim, Daijin .
INTERNATIONAL JOURNAL OF INTERACTIVE MULTIMEDIA AND ARTIFICIAL INTELLIGENCE, 2017, 4 (04) :54-62
[40]   Detection of Small Floating Targets on the Sea Surface Based on Multi-Features and Principal Component Analysis [J].
Gu, Tianchang .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (05) :809-813