A combined algorithm of K-means and MTRL for multi-class classification

被引:0
作者
XUE Mengfan [1 ]
HAN Lei [1 ]
PENG Dongliang [1 ]
机构
[1] School of Automation, Hangzhou Dianzi University
基金
中国国家自然科学基金;
关键词
machine learning; multi-class classification; K-means; multi-task relationship learning(MTRL); over-fitting;
D O I
暂无
中图分类号
TP181 [自动推理、机器学习];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The basic idea of multi-class classification is a disassembly method, which is to decompose a multi-class classification task into several binary classification tasks. In order to improve the accuracy of multi-class classification in the case of insufficient samples, this paper proposes a multi-class classification method combining K-means and multi-task relationship learning(MTRL).The method first uses the split method of One vs. Rest to disassemble the multi-class classification task into binary classification tasks. K-means is used to down sample the dataset of each task,which can prevent over-fitting of the model while reducing training costs. Finally, the sampled dataset is applied to the MTRL, and multiple binary classifiers are trained together. With the help of MTRL, this method can utilize the inter-task association to train the model, and achieve the purpose of improving the classification accuracy of each binary classifier. The effectiveness of the proposed approach is demonstrated by experimental results on the Iris dataset, Wine dataset, Multiple Features dataset, Wireless Indoor Localization dataset and Avila dataset.
引用
收藏
页码:875 / 885
页数:11
相关论文
共 50 条
  • [21] K-Means Clustering Efficient Algorithm with Initial Class Center Selection
    Huang Suyu
    Hu Pingfang
    PROCEEDINGS OF THE 2018 3RD INTERNATIONAL WORKSHOP ON MATERIALS ENGINEERING AND COMPUTER SCIENCES (IWMECS 2018), 2018, 78 : 301 - 305
  • [22] Fast Means: Enhancing the K-Means Algorithm by Accelerating its Early Classification Version
    Mexicano, A.
    Rodriguez, R.
    Cervantes, S.
    Ponce, R.
    Bernal, W.
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE OF NUMERICAL ANALYSIS AND APPLIED MATHEMATICS 2014 (ICNAAM-2014), 2015, 1648
  • [23] MULTI-CLASS DATA CLASSIFICATION FOR IMBALANCED DATA SET USING COMBINED SAMPLING APPROACHES
    Prachuabsupakij, Wanthanee
    Snonthornphisaj, Nuanwan
    KDIR 2011: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND INFORMATION RETRIEVAL, 2011, : 166 - 171
  • [24] Soil data clustering by using K-means and fuzzy K-means algorithm
    Hot, Elma
    Popovic-Bugarin, Vesna
    2015 23RD TELECOMMUNICATIONS FORUM TELFOR (TELFOR), 2015, : 890 - 893
  • [25] A new multi-class support vector algorithm
    Zhong, P
    Fukushima, M
    OPTIMIZATION METHODS & SOFTWARE, 2006, 21 (03) : 359 - 372
  • [26] Combined Elephant Herding Optimization Algorithm with K-means for Data Clustering
    Tuba, Eva
    Dolicanin-Djekic, Diana
    Jovanovic, Raka
    Simian, Dana
    Tuba, Milan
    INFORMATION AND COMMUNICATION TECHNOLOGY FOR INTELLIGENT SYSTEMS, ICTIS 2018, VOL 2, 2019, 107 : 665 - 673
  • [27] Multi-class Classification of Industrial Fall from Height based on Machine Learning Algorithm
    Koo, Bum Mo
    Kim, Jong Man
    Nam, Ye Jin
    Sung, Dong Jin
    Shim, Jae Woo
    Yang, Su Min
    Kim, Young Ho
    TRANSACTIONS OF THE KOREAN SOCIETY OF MECHANICAL ENGINEERS A, 2022, 46 (03) : 259 - 265
  • [28] Collaborative filtering system based on classification and extended K-means algorithm
    Wu Y.K.
    Tang Z.H.
    Advances in Information Sciences and Service Sciences, 2011, 3 (07): : 187 - 194
  • [29] The Modularity-based Hierarchical Tree Algorithm for Multi-class Classification
    Gu, Chengwei
    Zhang, Bofeng
    Wan, Xinyue
    Huang, Mingqing
    Zou, Guobing
    2016 17TH IEEE/ACIS INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, ARTIFICIAL INTELLIGENCE, NETWORKING AND PARALLEL/DISTRIBUTED COMPUTING (SNPD), 2016, : 625 - 629
  • [30] A machine learning model for multi-class classification of quenched and partitioned steel microstructure type by the k-nearest neighbor algorithm
    Gupta, Ashutosh Kumar
    Chakroborty, Sunny
    Ghosh, Swarup Kumar
    Ganguly, Subhas
    COMPUTATIONAL MATERIALS SCIENCE, 2023, 228