A study of spam filtering using support vector machines

被引:72
作者
Amayri, Ola [1 ]
Bouguila, Nizar [1 ]
机构
[1] Concordia Univ, Concordia Inst Informat Syst Engn, Montreal, PQ, Canada
关键词
Spam filtering; Support vector machines; String kernels; Feature mapping; Online active; CLASSIFICATION;
D O I
10.1007/s10462-010-9166-x
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Electronic mail is a major revolution taking place over traditional communication systems due to its convenient, economical, fast, and easy to use nature. A major bottleneck in electronic communications is the enormous dissemination of unwanted, harmful emails known as spam emails. A major concern is the developing of suitable filters that can adequately capture those emails and achieve high performance rate. Machine learning (ML) researchers have developed many approaches in order to tackle this problem. Within the context of machine learning, support vector machines (SVM) have made a large contribution to the development of spam email filtering. Based on SVM, different schemes have been proposed through text classification approaches (TC). A crucial problem when using SVM is the choice of kernels as they directly affect the separation of emails in the feature space. This paper presents thorough investigation of several distance-based kernels and specify spam filtering behaviors using SVM. The majority of used kernels in recent studies concern continuous data and neglect the structure of the text. In contrast to classical kernels, we propose the use of various string kernels for spam filtering. We show how effectively string kernels suit spam filtering problem. On the other hand, data preprocessing is a vital part of text classification where the objective is to generate feature vectors usable by SVM kernels. We detail a feature mapping variants in TC that yield improved performance for the standard SVM in filtering task. Furthermore, to cope for realtime scenarios we propose an online active framework for spam filtering. We present empirical results from an extensive study of online, transductive, and online active methods for classifying spam emails in real time. We show that active online method using string kernels achieves higher precision and recall rates.
引用
收藏
页码:73 / 108
页数:36
相关论文
共 64 条
  • [1] Abadi M., 2003, P 10 ANN NETWORK DIS, P25
  • [2] CLASSIFICATION INTO 2 MULTIVARIATE NORMAL-DISTRIBUTIONS WITH DIFFERENT COVARIANCE MATRICES
    ANDERSON, TW
    BAHADUR, RR
    [J]. ANNALS OF MATHEMATICAL STATISTICS, 1962, 33 (02): : 420 - &
  • [3] Androutsopoulos I., 2000, Proceedings of the Workshop on Machine Learning in the New Information Age, P9
  • [4] Androutsopoulos Ion., 2000, P WORKSHOP MACHINE L, P1
  • [5] [Anonymous], 2000, Advances in Neural Information Processing Systems (NeurIPS)
  • [6] [Anonymous], 1984, GRAD TEXTS MATH
  • [7] [Anonymous], 1953, Methods of mathematical physics
  • [8] [Anonymous], 2005, P TREC
  • [9] Back A., 2002, HASHCASH A DENIAL SE
  • [10] A survey of learning-based techniques of email spam filtering
    Blanzieri, Enrico
    Bryl, Anton
    [J]. ARTIFICIAL INTELLIGENCE REVIEW, 2008, 29 (01) : 63 - 92