A combined algorithm of K-means and MTRL for multi-class classification

被引:0
作者
XUE Mengfan [1 ]
HAN Lei [1 ]
PENG Dongliang [1 ]
机构
[1] School of Automation, Hangzhou Dianzi University
基金
中国国家自然科学基金;
关键词
machine learning; multi-class classification; K-means; multi-task relationship learning(MTRL); over-fitting;
D O I
暂无
中图分类号
TP181 [自动推理、机器学习];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The basic idea of multi-class classification is a disassembly method, which is to decompose a multi-class classification task into several binary classification tasks. In order to improve the accuracy of multi-class classification in the case of insufficient samples, this paper proposes a multi-class classification method combining K-means and multi-task relationship learning(MTRL).The method first uses the split method of One vs. Rest to disassemble the multi-class classification task into binary classification tasks. K-means is used to down sample the dataset of each task,which can prevent over-fitting of the model while reducing training costs. Finally, the sampled dataset is applied to the MTRL, and multiple binary classifiers are trained together. With the help of MTRL, this method can utilize the inter-task association to train the model, and achieve the purpose of improving the classification accuracy of each binary classifier. The effectiveness of the proposed approach is demonstrated by experimental results on the Iris dataset, Wine dataset, Multiple Features dataset, Wireless Indoor Localization dataset and Avila dataset.
引用
收藏
页码:875 / 885
页数:11
相关论文
共 50 条
  • [41] Improved K-means clustering algorithm
    Zhang, Zhe
    Zhang, Junxi
    Xue, Huifeng
    CISP 2008: FIRST INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, VOL 5, PROCEEDINGS, 2008, : 169 - 172
  • [42] A k-means based clustering algorithm
    Bloisi, Domenico Daniele
    Locchi, Luca
    COMPUTER VISION SYSTEMS, PROCEEDINGS, 2008, 5008 : 109 - 118
  • [43] Reduction Stumps for Multi-class Classification
    Mohr, Felix
    Wever, Marcel
    Huellermeier, Eyke
    ADVANCES IN INTELLIGENT DATA ANALYSIS XVII, IDA 2018, 2018, 11191 : 225 - 237
  • [44] Multi-class pattern classification using neural networks
    Ou, Guobin
    Murphey, Yi Lu
    PATTERN RECOGNITION, 2007, 40 (01) : 4 - 18
  • [45] Modified k-Means Clustering Algorithm
    Patel, Vaishali R.
    Mehta, Rupa G.
    COMPUTATIONAL INTELLIGENCE AND INFORMATION TECHNOLOGY, 2011, 250 : 307 - +
  • [46] Parzen windows for multi-class classification
    Pan, Zhi-Wei
    Xiang, Dao-Hong
    Xiao, Quan-Wu
    Zhou, Ding-Xuan
    JOURNAL OF COMPLEXITY, 2008, 24 (5-6) : 606 - 618
  • [47] Multi-agent Reinforcement Learning Based on K-Means Algorithm
    Liu Changan
    Liu Fei
    Liu Chunyang
    Wu Hua
    CHINESE JOURNAL OF ELECTRONICS, 2011, 20 (03): : 414 - 418
  • [48] The kernel rough k-means algorithm
    Meng W.
    Hongyan D.
    Shiyuan Z.
    Zhankui D.
    Zige W.
    Recent Advances in Computer Science and Communications, 2020, 13 (02) : 234 - 239
  • [49] An improved K-means clustering algorithm
    Huang, Xiuchang
    Su, Wei
    Journal of Networks, 2014, 9 (01) : 161 - 167
  • [50] Improved Algorithm for the k-means Clustering
    Zhang, Sheng
    Wang, Shouqiang
    PROCEEDINGS OF THE 10TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA 2012), 2012, : 4717 - 4720