Research on Parallelization of Logsf Feature Selection Algorithm

被引:0
|
作者
Guo, Aizhang [1 ]
Zhang, Ningning [1 ]
Sun, Tao [1 ]
机构
[1] Qilu Univ Technol, Sch Informat, Tinan, Peoples R China
来源
PROCEEDINGS OF 2018 IEEE 3RD ADVANCED INFORMATION TECHNOLOGY, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (IAEAC 2018) | 2018年
关键词
Hadoop; feature selection; local learning; Logsf algorithm; MapReduce; EIGENFACES;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the advent of the large data age, it is becoming more and more important to reduce the dimension of data. As a common means of data reduction preprocessing, feature selection has attracted more and more attention in recent years. At present, it is mainly based on the traditional feature selection algorithm, but the traditional method has been unable to meet the requirements of massive high-dimensional data processing. So, this paper studies the Logsf feature selection algorithm based on local learning, and improves the shortcomings of the existing algorithm. Then, by using the Mapreduce framework in the Hadoop platform, the improved Logsf feature selection algorithm is designed and implemented in parallel. Finally, the experimental results show that the improved Logsf feature selection algorithm for parallel processing is superior to the existing Logsf feature selection algorithm in the accuracy and the speedup. It fully shows that the characteristics of the parallel Logsf algorithm has a good reliability in this paper.
引用
收藏
页码:2143 / 2147
页数:5
相关论文
共 50 条
  • [1] Multithreaded and Spark parallelization of feature selection filters
    Eiras-Franco, Carlos
    Bolon-Canedo, Veronica
    Ramos, Sabela
    Gonzalez-Dominguez, Jorge
    Alonso-Betanzos, Amparo
    Tourino, Juan
    JOURNAL OF COMPUTATIONAL SCIENCE, 2016, 17 : 609 - 619
  • [2] Research on Feature Selection Algorithm of Energy Curve
    Fan, Xiaohong
    Huang, Ye
    Wang, Xue
    Nie, Ziran
    Yu, Zhenyang
    Cheng, Xuhui
    Duan, Xiaoyi
    DIGITAL FORENSICS AND CYBER CRIME, PT 1, ICDF2C 2023, 2024, 570 : 293 - 307
  • [3] Research on Feature Selection Algorithm Based on Mixed Model
    He, Ming
    ICCEE 2008: PROCEEDINGS OF THE 2008 INTERNATIONAL CONFERENCE ON COMPUTER AND ELECTRICAL ENGINEERING, 2008, : 70 - 72
  • [4] Research and Improvements on Crow Search Algorithm for Feature Selection
    Lian J.
    Yao X.
    Li Z.-S.
    Ruan Jian Xue Bao/Journal of Software, 2022, 33 (11): : 3903 - 3916
  • [5] Research on Feature Selection Based on Hybrid Evolutionary Algorithm
    Gao H.-M.
    Wang Y.-H.
    Bian C.
    Li X.-T.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2023, 51 (06): : 1619 - 1636
  • [6] Research on the Feature Selection Algorithm of Chinese News Classification
    Gong, Jun-peng
    Wen, Yu-jun
    Song, Qing
    INTERNATIONAL CONFERENCE ON SIMULATION, MODELLING AND MATHEMATICAL STATISTICS (SMMS 2015), 2015, : 455 - 458
  • [7] Algorithm research about feature selection based on fractal dimension
    Wu, Xinling
    Zhou, Guoqiang
    2010 THE 3RD INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND INDUSTRIAL APPLICATION (PACIIA2010), VOL VII, 2010, : 414 - 417
  • [8] Research on Improvements of Feature Selection Using Forest Optimization Algorithm
    Chu B.
    Li Z.-S.
    Zhang M.-L.
    Yu H.-H.
    Ruan Jian Xue Bao/Journal of Software, 2018, 29 (09): : 2547 - 2558
  • [9] Algorithm research about feature selection based on fractal dimension
    Wu, Xinling
    Zhou, Guoqiang
    2011 INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTATION AND INDUSTRIAL APPLICATION (ICIA2011), VOL II, 2011, : 413 - 416
  • [10] Research on Feature Selection Algorithm Based on Natural Evolution Strategy
    Zhang X.
    Li Z.-S.
    Ruan Jian Xue Bao/Journal of Software, 2020, 31 (12): : 3733 - 3752