An efficient multi-metric learning method by partitioning the metric space

被引:3
|
作者
Yuan, Chao [1 ]
Yang, Liming [1 ,2 ]
机构
[1] China Agr Univ, Coll Informat & Elect Engn, Beijing 100083, Peoples R China
[2] China Agr Univ, Coll Sci, Beijing 100083, Peoples R China
基金
中国国家自然科学基金;
关键词
Classification; Multi -metric learning; Distance metric; Semi -supervised learning; Robustness; DISTANCE; CLASSIFICATION; ROBUSTNESS;
D O I
10.1016/j.neucom.2023.01.074
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Metric learning has attracted significant attention due to its high effectiveness and efficiency for pattern recognition task. Traditional supervised metric learning algorithms attempt to seek a global distance metric with labeled samples. When data are represented with multimodal and only limited supervision information is available, these approaches are insufficient to obtain satisfactory results. In this paper, we develop a robust semi-supervised multi-metric learning method (RSMM) to improve classification per-formance. The proposed RSMM learns multiple local metrics and a background metric instead of a single global metric. Specifically, we divide the metric space into influential regions and background region, and then regulate the effectiveness of each local metric to be within the related regions. Simultaneously, a geometrically interpretable, symmetric distance is defined with local metrics and background metric. Based on the resultant learning bounds, we obtain the regularization term to improve the classifier's gen-eralization ability. Moreover, the manifold regularization term is introduced to preserve the supervision information as well as geometry structure. The substantial unlabeled samples may cause potential threats and large uncertainties, so the logarithmic loss function is utilized to enhance the robustness. An efficient gradient descent algorithm is exploited to solve the non-convex challenging problem. To fur-ther understand the proposed algorithm, we theoretically derive its robustness and generalization error bounds. Finally, numerical experiments on UCI datasets and image datasets demonstrate the feasibility and validity of the RSMM.(c) 2023 Published by Elsevier B.V.
引用
收藏
页码:56 / 79
页数:24
相关论文
共 50 条
  • [1] An efficient method for clustered multi-metric learning
    Bac Nguyen
    Ferri, Francesc J.
    Morell, Carlos
    De Baets, Bernard
    INFORMATION SCIENCES, 2019, 471 : 149 - 163
  • [2] Multi-metric learning by a pair of twin-metric learning framework
    Min Zhang
    Liming Yang
    Chao Yuan
    Qiangqiang Ren
    Applied Intelligence, 2022, 52 : 17490 - 17507
  • [3] Multi-metric learning by a pair of twin-metric learning framework
    Zhang, Min
    Yang, Liming
    Yuan, Chao
    Ren, Qiangqiang
    APPLIED INTELLIGENCE, 2022, 52 (15) : 17490 - 17507
  • [4] Deep multi-metric training: the need of multi-metric curve evaluation to avoid weak learning
    Mamalakis, Michail
    Banerjee, Abhirup
    Ray, Surajit
    Wilkie, Craig
    Clayton, Richard H.
    Swift, Andrew J.
    Panoutsos, George
    Vorselaars, Bart
    Neural Computing and Applications, 2024, 36 (30) : 18841 - 18862
  • [5] Large margin projection-based multi-metric learning for classification
    Yuan, Chao
    Yang, Liming
    KNOWLEDGE-BASED SYSTEMS, 2022, 243
  • [6] Multi-Metric Induced Robust Graph
    Geng, Zengmin
    Sun, Xiaodong
    Du, Jianxia
    Zhang, Jujian
    Zhou, Yiling
    IEEE ACCESS, 2021, 9 : 94996 - 95005
  • [7] A multi-metric small sphere large margin method for classification
    Zhao, Yifeng
    Yang, Liming
    PATTERN ANALYSIS AND APPLICATIONS, 2023, 26 (04) : 1615 - 1629
  • [8] A REGULARIZED MULTI-METRIC ACTIVE LEARNING FRAMEWORK FOR HYPERSPECTRAL IMAGE CLASSIFICATION
    Zhang, Zhou
    Crawford, Melba M.
    2016 8TH WORKSHOP ON HYPERSPECTRAL IMAGE AND SIGNAL PROCESSING: EVOLUTION IN REMOTE SENSING (WHISPERS), 2016,
  • [9] SEMI-SUPERVISED MULTI-METRIC ACTIVE LEARNING FOR CLASSIFICATION OF HYPERSPECTRAL IMAGES
    Zhang, Zhou
    Crawford, Melba M.
    2016 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2016, : 1843 - 1846
  • [10] A multi-metric small sphere large margin method for classification
    Yifeng Zhao
    Liming Yang
    Pattern Analysis and Applications, 2023, 26 : 1615 - 1629