Data models;
Mathematical models;
Transformers;
Brain modeling;
Training;
Software;
Signal processing;
Incomplete multi-view clustering;
distillation learning;
contrastive learning;
D O I:
10.1109/LSP.2023.3302234
中图分类号:
TM [电工技术];
TN [电子技术、通信技术];
学科分类号:
0808 ;
0809 ;
摘要:
In recent years, multi-view clustering has gained widespread attention in signal processing because multi-view data contains more information than a single view. However, multi-view data is often incomplete due to missing data in one or more random views. Therefore, several methods have been proposed for incomplete multi-view clustering to learn features that contain consensus information for clustering incomplete multi-view data (IMD). However, there is a part of the IMD that is not missing in any view, and most previous methods have not utilized this part to guide the process of learning consensus information. To address this issue, we design a knowledge distillation framework for incomplete multi-view clustering and propose an incomplete multi-view clustering with complete view guidance (IMC-CVG). We first train a robust teacher model with contrastive learning loss on the complete part of IMD to learn consensus features containing multi-view information. Then, we train a student model on all the IMD, where we mask partial views of the complete data to simulate missing data, and utilize the teacher model to guide the student model to learn consensus features that contain as much multi-view information as possible. Experiments show that our proposed method outperforms all the compared state-of-the-art methods.
机构:
Guangdong Univ Technol, Sch Automat, Guangzhou 510006, Peoples R China
Minist Educ, Key Lab Intelligent Informat Proc & Syst Integrat, Guangzhou 510006, Peoples R ChinaGuangdong Univ Technol, Sch Automat, Guangzhou 510006, Peoples R China
Zheng, Yanghang
Zhou, Guoxu
论文数: 0引用数: 0
h-index: 0
机构:
Guangdong Univ Technol, Sch Automat, Guangzhou 510006, Peoples R China
Minist Educ, Key Lab Intelligent Detect & Internet Things Mfg, Guangzhou 510006, Peoples R ChinaGuangdong Univ Technol, Sch Automat, Guangzhou 510006, Peoples R China
Zhou, Guoxu
Huang, Haonan
论文数: 0引用数: 0
h-index: 0
机构:
Guangdong Univ Technol, Sch Automat, Guangzhou 510006, Peoples R China
RIKEN AIP, Tokyo, JapanGuangdong Univ Technol, Sch Automat, Guangzhou 510006, Peoples R China
Huang, Haonan
Luo, Xintao
论文数: 0引用数: 0
h-index: 0
机构:
Guangdong Univ Technol, Guangdong Key Lab IoT Informat Technol, Guangzhou 510006, Peoples R China
Guangdong HongKong Macao Joint Lab Smart Discrete, Guangzhou 510006, Guangdong, Peoples R ChinaGuangdong Univ Technol, Sch Automat, Guangzhou 510006, Peoples R China
Luo, Xintao
Huang, Zhenhao
论文数: 0引用数: 0
h-index: 0
机构:
Guangdong Univ Technol, Sch Automat, Guangzhou 510006, Peoples R China
111 Ctr Intelligent Batch Mfg Based IoT Technol, Guangzhou 510006, Peoples R ChinaGuangdong Univ Technol, Sch Automat, Guangzhou 510006, Peoples R China
Huang, Zhenhao
Zhao, Qibin
论文数: 0引用数: 0
h-index: 0
机构:
Guangdong Univ Technol, Sch Automat, Guangzhou 510006, Peoples R China
RIKEN AIP, Tokyo, JapanGuangdong Univ Technol, Sch Automat, Guangzhou 510006, Peoples R China
机构:
Univ Macau, Dept Comp & Informat Sci, PAMI Res Grp, Taipa, Macau, Peoples R ChinaUniv Macau, Dept Comp & Informat Sci, PAMI Res Grp, Taipa, Macau, Peoples R China
Wen, Jie
Sun, Huijie
论文数: 0引用数: 0
h-index: 0
机构:
Nanchang Inst Technol, Nanchang 330044, Jiangxi, Peoples R China
Sun Yat Sen Univ, Guangzhou 510000, Peoples R ChinaUniv Macau, Dept Comp & Informat Sci, PAMI Res Grp, Taipa, Macau, Peoples R China
Sun, Huijie
Fei, Lunke
论文数: 0引用数: 0
h-index: 0
机构:
Guangdong Univ Technol, Sch Comp Sci & Technol, Guangzhou 510006, Peoples R ChinaUniv Macau, Dept Comp & Informat Sci, PAMI Res Grp, Taipa, Macau, Peoples R China
Fei, Lunke
Li, Jinxing
论文数: 0引用数: 0
h-index: 0
机构:
Chinese Univ Hong Kong Shenzhen, Sch Sci & Engn, Shenzhen 518000, Peoples R ChinaUniv Macau, Dept Comp & Informat Sci, PAMI Res Grp, Taipa, Macau, Peoples R China
Li, Jinxing
Zhang, Zheng
论文数: 0引用数: 0
h-index: 0
机构:
Harbin Inst Technol, Shenzhen Key Lab Visual Object Detect & Recognit, Shenzhen 518055, Shenzhen, Peoples R China
Peng Cheng Lab, Shenzhen 518055, Peoples R ChinaUniv Macau, Dept Comp & Informat Sci, PAMI Res Grp, Taipa, Macau, Peoples R China
Zhang, Zheng
Zhang, Bob
论文数: 0引用数: 0
h-index: 0
机构:
Univ Macau, Dept Comp & Informat Sci, PAMI Res Grp, Taipa, Macau, Peoples R ChinaUniv Macau, Dept Comp & Informat Sci, PAMI Res Grp, Taipa, Macau, Peoples R China