A network-based CNN model to identify the hidden information in text data

被引:8
作者
Liu, Yanyan [1 ]
Li, Keping [1 ]
Yan, Dongyang [1 ]
Gu, Shuang [1 ]
机构
[1] Beijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R China
基金
中国国家自然科学基金;
关键词
Text data; Hidden information detection; Network model; Random walk; CNN; BAYESIAN NETWORKS; COMPLEX NETWORKS; LANGUAGE;
D O I
10.1016/j.physa.2021.126744
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
With the development of the internet and big data, the missing or hidden information identification of text data has become an imperative task. At present, the challenge in the hidden information study is judging whether there is hidden information and where it exists. In this paper, hidden information refers to the words that do not appear in a sentence, however, they have certain correlations with the existing words or sentence and have a great influence on the comprehension of a sentence or part of the text data. This paper focuses on discovering the key and influential hidden information in the text data. A keyword-based hidden information extraction framework is proposed in this paper to search hidden entities, with the assumption that the importance of hidden objects is reflected by the keywords in the text data. A network-based Convolution Neural Network (CNN) model is developed to identify the hidden information related to keywords. The model is based on the results of CNN, and cosine similarity is used to judge whether there is hidden information in the source text data or not. We primarily form the word co-occurrence network of text, select the words with the highest degree as keywords, and generate random walk paths on the network. Besides, we use the random walk path where the last word is the keyword to train CNN. In the experimental section, the proposed model is applied to the dataset in 20Newgroups. The results show that the proposed model can effectively identify the hidden information associated with the keywords in the source text data, and the detection accuracy of keywords can reach 98%-99% achieved by CNN. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:16
相关论文
共 48 条
[21]   Text mining by Tsallis entropy [J].
Jamaati, Maryam ;
Mehri, Ali .
PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2018, 490 :1368-1376
[22]   Community detection in complex networks with an ambiguous structure using central node based link prediction [J].
Jiang, Hao ;
Liu, Zhenjie ;
Liu, Chunlong ;
Su, Yansen ;
Zhang, Xingyi .
KNOWLEDGE-BASED SYSTEMS, 2020, 195
[23]  
Kim Y, 2016, AAAI CONF ARTIF INTE, P2741
[24]  
Li JZ, 2016, PROCEEDINGS OF THE 54TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 1, P1004
[25]   Extracting hidden fluctuation patterns of Hang Seng stock index from network topologies [J].
Li, Ping ;
Wang, Bing-Hong .
PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2007, 378 (02) :519-526
[26]   Word-class embeddings for multiclass text classification [J].
Moreo, Alejandro ;
Esuli, Andrea ;
Sebastiani, Fabrizio .
DATA MINING AND KNOWLEDGE DISCOVERY, 2021, 35 (03) :911-963
[27]   Analyzing business process anomalies using autoencoders [J].
Nolle, Timo ;
Luettgen, Stefan ;
Seeliger, Alexander ;
Muehlhaeuser, Max .
MACHINE LEARNING, 2018, 107 (11) :1875-1893
[28]  
Pennington J., 2014, P 2014 C EMP METH NA, P1532
[29]   DeepWalk: Online Learning of Social Representations [J].
Perozzi, Bryan ;
Al-Rfou, Rami ;
Skiena, Steven .
PROCEEDINGS OF THE 20TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING (KDD'14), 2014, :701-710
[30]   On the detection of trends in long-term correlated records [J].
Rybski, Diego ;
Bunde, Armin .
PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2009, 388 (08) :1687-1695