Research on the Text Data Mining and Clustering Algorithm based on the Bayesian Theory and Markov Random Fields

被引:0
|
作者
Sheng, Xiaobao [1 ]
Luo, Yimin [1 ]
Cao, Xiaodong [1 ]
Tao, Junjie [1 ]
机构
[1] Minist Publ Secur, Res Inst 3, Shanghai 200031, Peoples R China
关键词
Text Data Mining; Bayesian Theory; Markov Random Fields; Pattern Clustering;
D O I
暂无
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
In this paper, we research on the text data mining and clustering algorithm based on Bayesian theory and Markov random fields. Clustering analysis is an important means of realization of text mining. However, the text data with high dimension, sparse data distribution and the core characteristics of different categories of overlapping important characteristics such as the great challenges for practical applications. In recent years, the soft subspace clustering technology has become the focus in the academic circles. Its basic idea is to give the data set of all kinds of don't give the characteristics of the different weight vectors, used to represent the clustering process in the contribution of each feature in this category. Our algorithm combines the advances of the Bayesian theory and Markov random fields to help enhance the overall performance.
引用
收藏
页码:136 / 141
页数:6
相关论文
共 50 条
  • [21] Learning Bayesian Networks from Markov Random Fields: An Efficient Algorithm for Linear Models
    Wang, Zhenxing
    Chan, Laiwan
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2012, 6 (03)
  • [22] Research on the Massive Redundant Data Mining Algorithm based on Kernel Clustering and Data Cleaning Technology
    Mao, YaoFeng
    2015 2ND INTERNATIONAL SYMPOSIUM ON ENGINEERING TECHNOLOGY, EDUCATION AND MANAGEMENT (ISETEM 2015), 2015, : 112 - 117
  • [23] Markov Random Field-based Clustering of Vibration Data
    Komma, Philippe
    Zell, Andreas
    IEEE/RSJ 2010 INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2010), 2010, : 1902 - 1908
  • [24] ABNORMALITY DETECTION BY GENERATING RANDOM FIELDS BASED ON MARKOV RANDOM FIELD THEORY
    NagaRaju, C.
    SivaSankarReddy, L.
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2008, 8 (05): : 260 - 263
  • [25] Research on Text Mining Algorithm Based on Focused Crawler
    Zhang, Qiusheng
    Lin, Mingyu
    Jun, Jianping
    Zhang, Xingyun
    2017 12TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND EDUCATION (ICCSE 2017), 2017, : 454 - 457
  • [26] Data mining algorithm for text data
    Chen, Yuquan
    Zhu, Xijun
    Lu, Ruzhan
    Shanghai Jiaotong Daxue Xuebao/Journal of Shanghai Jiaotong University, 2000, 34 (07): : 936 - 938
  • [27] Exploratory data mining lead by text mining using a novel high dimensional clustering algorithm
    Amarasiri, R
    Ceddia, J
    Alahakoon, D
    ICMLA 2005: FOURTH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, PROCEEDINGS, 2005, : 267 - 272
  • [28] Double Markov random fields and Bayesian image segmentation
    Melas, DE
    Wilson, SP
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2002, 50 (02) : 357 - 365
  • [29] Bayesian image classification using Markov random fields
    Berthod, M
    Kato, Z
    Yu, S
    Zerubia, J
    IMAGE AND VISION COMPUTING, 1996, 14 (04) : 285 - 295
  • [30] On Gaussian Markov random fields and Bayesian disease mapping
    MacNab, Ying C.
    STATISTICAL METHODS IN MEDICAL RESEARCH, 2011, 20 (01) : 49 - 68