Data models;
Mathematical models;
Transformers;
Brain modeling;
Training;
Software;
Signal processing;
Incomplete multi-view clustering;
distillation learning;
contrastive learning;
D O I:
10.1109/LSP.2023.3302234
中图分类号:
TM [电工技术];
TN [电子技术、通信技术];
学科分类号:
0808 ;
0809 ;
摘要:
In recent years, multi-view clustering has gained widespread attention in signal processing because multi-view data contains more information than a single view. However, multi-view data is often incomplete due to missing data in one or more random views. Therefore, several methods have been proposed for incomplete multi-view clustering to learn features that contain consensus information for clustering incomplete multi-view data (IMD). However, there is a part of the IMD that is not missing in any view, and most previous methods have not utilized this part to guide the process of learning consensus information. To address this issue, we design a knowledge distillation framework for incomplete multi-view clustering and propose an incomplete multi-view clustering with complete view guidance (IMC-CVG). We first train a robust teacher model with contrastive learning loss on the complete part of IMD to learn consensus features containing multi-view information. Then, we train a student model on all the IMD, where we mask partial views of the complete data to simulate missing data, and utilize the teacher model to guide the student model to learn consensus features that contain as much multi-view information as possible. Experiments show that our proposed method outperforms all the compared state-of-the-art methods.
机构:
South Cent Minzu Univ, Wuhan 430074, Peoples R China
South Cent Minzu Univ, Key Lab Cyber Phys Fus Intelligent Comp, State Ethn Affairs Commiss, Wuhan 430074, Peoples R ChinaSouth Cent Minzu Univ, Wuhan 430074, Peoples R China
Zhang, Xiao
Pu, Xinyu
论文数: 0引用数: 0
h-index: 0
机构:
Southwest Univ, Coll Elect & Informat Engn, Chongqing 400715, Peoples R ChinaSouth Cent Minzu Univ, Wuhan 430074, Peoples R China
Pu, Xinyu
Che, Hangjun
论文数: 0引用数: 0
h-index: 0
机构:
Southwest Univ, Coll Elect & Informat Engn, Chongqing 400715, Peoples R China
Chongqing Key Lab Nonlinear Circuits & Intelligent, Chongqing 400715, Peoples R ChinaSouth Cent Minzu Univ, Wuhan 430074, Peoples R China
Che, Hangjun
Liu, Cheng
论文数: 0引用数: 0
h-index: 0
机构:
Shantou Univ, Dept Comp Sci, Shantou 515063, Peoples R China
Shantou Univ, Guangdong Prov Key Lab Infect Dis & Mol Immunopath, Shantou 515063, Peoples R ChinaSouth Cent Minzu Univ, Wuhan 430074, Peoples R China
Liu, Cheng
Qin, Jun
论文数: 0引用数: 0
h-index: 0
机构:
South Cent Minzu Univ, Wuhan 430074, Peoples R China
South Cent Minzu Univ, Key Lab Cyber Phys Fus Intelligent Comp, State Ethn Affairs Commiss, Wuhan 430074, Peoples R ChinaSouth Cent Minzu Univ, Wuhan 430074, Peoples R China