Multilayer networks for text analysis with multiple data types

被引:0
作者
Charles C. Hyland
Yuanming Tao
Lamiae Azizi
Martin Gerlach
Tiago P. Peixoto
Eduardo G. Altmann
机构
[1] The University of Sydney,School of Mathematics and Statistics
[2] Wikimedia Foundation,Department of Network and Data Science
[3] Central European University,Department of Mathematical Sciences
[4] University of Bath,undefined
来源
EPJ Data Science | / 10卷
关键词
Stochastic block models; Multilayer networks; Natural language processing; Complex systems; Data science;
D O I
暂无
中图分类号
学科分类号
摘要
We are interested in the widespread problem of clustering documents and finding topics in large collections of written documents in the presence of metadata and hyperlinks. To tackle the challenge of accounting for these different types of datasets, we propose a novel framework based on Multilayer Networks and Stochastic Block Models. The main innovation of our approach over other techniques is that it applies the same non-parametric probabilistic framework to the different sources of datasets simultaneously. The key difference to other multilayer complex networks is the strong unbalance between the layers, with the average degree of different node types scaling differently with system size. We show that the latter observation is due to generic properties of text, such as Heaps’ law, and strongly affects the inference of communities. We present and discuss the performance of our method in different datasets (hundreds of Wikipedia documents, thousands of scientific papers, and thousands of E-mails) showing that taking into account multiple types of information provides a more nuanced view on topic- and document-clusters and increases the ability to predict missing links.
引用
收藏
相关论文
共 69 条
[1]  
Costanedo F(2013)A review of data fusion techniques Sci World J 2013 203-271
[2]  
Kivelä M(2014)Multilayer networks J Complex Netw 2 1-44
[3]  
Arenas A(2016)Combining complex networks and data mining: why and how Phys Rep 635 1775-1781
[4]  
Barthelemy M(2009)A density-based method for adaptive LDA model selection Neurocomputing 72 75-174
[5]  
Gleeson J(2016)Multilayer stochastic block models reveal the multilayer structure of complex networks Phys Rev X 6 22073-22078
[6]  
Moreno Y(2015)Inferring the mesoscale structure of layered, edge-valued and time-varying networks Phys Rev E 92 465-471
[7]  
Porter M(2011)Efficient and principled method for detecting communities in networks Phys Rev E 84 98-101
[8]  
Zanin M(2015)High-reproducibility and high-accuracy method for automated topic classification Phys Rev X 5 undefined-undefined
[9]  
Papo D(2018)A network approach to topic models Sci Adv 4 undefined-undefined
[10]  
Sousa PA(2010)Community detection in graphs Phys Rep 486 undefined-undefined