Pairwise Constraint Propagation With Dual Adversarial Manifold Regularization

被引:26
作者
Jia, Yuheng [1 ]
Liu, Hui [1 ]
Hou, Junhui [2 ,3 ]
Kwong, Sam [2 ,3 ]
机构
[1] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[2] City Univ Hong Kong, Dept Comp Sci, Kowloon, Hong Kong, Peoples R China
[3] City Univ Hong Kong, Shenzhen Res Inst, Shenzhen 51800, Peoples R China
关键词
Manifolds; Measurement; Computational modeling; Symmetric matrices; Urban areas; Task analysis; Convergence; Adversarial relationship; manifold regularization; pairwise constraint propagation (PCP); semisupervised;
D O I
10.1109/TNNLS.2020.2970195
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Pairwise constraints (PCs) composed of must-links (MLs) and cannot-links (CLs) are widely used in many semisupervised tasks. Due to the limited number of PCs, pairwise constraint propagation (PCP) has been proposed to augment them. However, the existing PCP algorithms only adopt a single matrix to contain all the information, which overlooks the differences between the two types of links such that the discriminability of the propagated PCs is compromised. To this end, this article proposes a novel PCP model via dual adversarial manifold regularization to fully explore the potential of the limited initial PCs. Specifically, we propagate MLs and CLs with two separated variables, called similarity and dissimilarity matrices, under the guidance of the graph structure constructed from data samples. At the same time, the adversarial relationship between the two matrices is taken into consideration. The proposed model is formulated as a nonnegative constrained minimization problem, which can be efficiently solved with convergence theoretically guaranteed. We conduct extensive experiments to evaluate the proposed model, including propagation effectiveness and applications on constrained clustering and metric learning, all of which validate the superior performance of our model to state-of-the-art PCP models.
引用
收藏
页码:5575 / 5587
页数:13
相关论文
共 50 条
[31]   Semi-supervised local manifold regularization model based on dual representation for industrial soft sensor development [J].
Shao, Weiming ;
Li, Xu ;
Yao, Yating ;
Chen, Junghui ;
Zhao, Dongya .
CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2023, 242
[32]   AdvMixUp: Adversarial MixUp Regularization for Deep Learning [J].
Fu, Jun ;
Ji, Xianrui ;
Chen, Dexiong ;
Hu, Guosheng ;
Li, Shuang ;
Feng, Xiating .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025,
[33]   Wasserstein Adversarial Regularization for Learning With Label Noise [J].
Fatras, Kilian ;
Damodaran, Bharath Bhushan ;
Lobry, Sylvain ;
Flamary, Remi ;
Tuia, Devis ;
Courty, Nicolas .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (10) :7296-7306
[34]   Semi-supervised learning via manifold regularization [J].
Mao, Yu ;
Zhou, Yan-Quan ;
Li, Rui-Fan ;
Wang, Xiao-Jie ;
Zhong, Yi-Xin .
Journal of China Universities of Posts and Telecommunications, 2012, 19 (06) :79-88
[35]   Dimensionality reduction: An interpretation from manifold regularization perspective [J].
Fan, Mingyu ;
Gu, Nannan ;
Qiao, Hong ;
Zhang, Bo .
INFORMATION SCIENCES, 2014, 277 :694-714
[36]   Pointwise manifold regularization for semi-supervised learning [J].
Wang, Yunyun ;
Han, Jiao ;
Shen, Yating ;
Xue, Hui .
FRONTIERS OF COMPUTER SCIENCE, 2021, 15 (01)
[37]   Total Variation Regularization for Manifold-Valued Data [J].
Weinmann, Andreas ;
Demaret, Laurent ;
Storath, Martin .
SIAM JOURNAL ON IMAGING SCIENCES, 2014, 7 (04) :2226-2257
[38]   A Distribution Dependent and Independent Complexity Analysis of Manifold Regularization [J].
Mey, Alexander ;
Viering, Tom Julian ;
Loog, Marco .
ADVANCES IN INTELLIGENT DATA ANALYSIS XVIII, IDA 2020, 2020, 12080 :326-338
[39]   Multiparametric tissue abnormality characterization using manifold regularization [J].
Batmanghelich, Kayhan ;
Wu, Xiaoying ;
Zacharaki, Evangelia ;
Markowitz, Clyde E. ;
Davatzikos, Christos ;
Verma, Ragini .
MEDICAL IMAGING 2008: COMPUTER-AIDED DIAGNOSIS, PTS 1 AND 2, 2008, 6915
[40]   MANIFOLD REGULARIZATION MULTIPLE KERNEL LEARNING MACHINE FOR CLASSIFICATION [J].
Fu, Dongmei ;
Yang, Tao .
PROCEEDINGS OF 2013 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS (ICMLC), VOLS 1-4, 2013, :304-310