A new semantic-based feature selection method for spam filtering

被引:54
作者
Mendez, Jose R. [1 ,2 ]
Cotos-Yanez, Tomas R. [2 ,3 ]
Ruano-Ordas, David [1 ,2 ]
机构
[1] Univ Vigo, Dept Comp Sci, ESEI, Campus Lagoas, Orense 32004, Spain
[2] Ctr Singular Invest Galicia, Ctr Invest Biomed, Campus Univ Lagoas Marcosende, Vigo 36310, Spain
[3] ESEI, Dept Stat & Operat Res, Campus Lagoas, Orense 32004, Spain
关键词
Feature selection methods; Text mining; Spam filtering; e-mail; Classification; Machine learning; SUPPORT VECTOR MACHINES; CONCEPT DRIFT; CLASSIFICATION; ALGORITHMS; REDUCTION;
D O I
10.1016/j.asoc.2018.12.008
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The Internet emerged as a powerful infrastructure for the worldwide communication and interaction of people. Some unethical uses of this technology (for instance spam or viruses) generated challenges in the development of mechanisms to guarantee an affordable and secure experience concerning its usage. This study deals with the massive delivery of unwanted content or advertising campaigns without the accordance of target users (also known as spam). Currently, words (tokens) are selected by using feature selection schemes; they are then used to create feature vectors for training different Machine Learning (ML) approaches. This study introduces a new feature selection method able to take advantage of a semantic ontology to group words into topics and use them to build feature vectors. To this end, we have compared the performance of nine well-known ML approaches in conjunction with (i) Information Gain, the most popular feature selection method in the spam-filtering domain and (ii) Latent Dirichlet Allocation, a generative statistical model that allows sets of observations to be explained by unobserved groups that describe why some parts of the data are similar, and (iii) our semantic-based feature selection proposal. Results have shown the suitability and additional benefits of topic-driven methods to develop and deploy high-performance spam filters. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:89 / 104
页数:16
相关论文
共 107 条
  • [1] Allman E., 2007, DO MAINKEYS IDENTIFI
  • [2] Allton M., 2013, MEDIA HAT
  • [3] Text normalization and semantic indexing to enhance Instant Messaging and SMS spam filtering
    Almeida, Tiago A.
    Silva, Tiago P.
    Santos, Igor
    Gomez Hidalgo, Jose M.
    [J]. KNOWLEDGE-BASED SYSTEMS, 2016, 108 : 25 - 32
  • [4] Feature selection using support vector machines and bootstrap methods for ventricular fibrillation detection
    Alonso-Atienza, Felipe
    Luis Rojo-Alvarez, Jose
    Rosado-Munoz, Alfredo
    Vinagre, Juan J.
    Garcia-Alberola, Arcadi
    Camps-Valls, Gustavo
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2012, 39 (02) : 1956 - 1967
  • [5] Androutsopoulos I., 2000, CSCL0009 CORR
  • [6] [Anonymous], AAAI SPRING S MACH L
  • [7] [Anonymous], 2005, SPAMASSASSIN PUBL MA
  • [8] [Anonymous], SPAM EM DAT
  • [9] Apache Software Foundation, 2007, AP SPAMASSASSIN PROJ
  • [10] Feature selection with Intelligent Dynamic Swarm and Rough Set
    Bae, Changseok
    Yeh, Wei-Chang
    Chung, Yuk Ying
    Liu, Sin-Long
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2010, 37 (10) : 7026 - 7032