Social media based event summarization by user-text-image co-clustering

被引:33
作者
Qian, Xueming [1 ]
Li, Mingdi [1 ,2 ]
Ren, Yayun [1 ,2 ]
Jiang, Shuhui [1 ,2 ]
机构
[1] Xi An Jiao Tong Univ, Sch Elect & Informat Engn, Dept Informat & Commun Engn, Xian, Shaanxi, Peoples R China
[2] Xi An Jiao Tong Univ, Key Lab Intelligent Networks & Network Secur, Minist Educ, Xian, Shaanxi, Peoples R China
关键词
Event summarization; Social media; Image summarization; Co-clustering;
D O I
10.1016/j.knosys.2018.10.028
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Microblogging services have changed the way that people exchange information. There will generate a large number of data on the web once popular events or emergencies occur, including textual descriptions about the time, location and details for the event. Meanwhile users can review, comment, spread the event conveniently. It has always been a hot issue that how to use this mass of data to detect and predict breaking events. While existing approaches mostly only focus on event detection, event location estimation and text-based summary, a small amount of works have focused on event summarization. In this paper, we put forward a new social media based event summarization framework, which comprises of three stages: (1) A coarse-to-fine filtering model is exploited to eliminate irrelevant information. (2) A novel User-Text-Image Co-clustering (UTICC) is proposed to jointly discover subevents from microblogs of multiple media types user, text, and image. (3)A multimedia event summarization process is designed to identify both representative texts and images, which are further aggregated to form a holistic visualized summary for the events. We conduct extensive experiments on Weibo dataset to demonstrate the superiority of the proposed framework compared to the state-of-the-art approaches. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:107 / 121
页数:15
相关论文
共 51 条
  • [1] Aiello L, 2015, IEEE T MULTIMEDIA, V15
  • [2] Alsaedi N, 2016, 2016 IEEE/WIC/ACM INTERNATIONAL CONFERENCE ON WEB INTELLIGENCE (WI 2016), P515, DOI [10.1109/WI.2016.86, 10.1109/WI.2016.0087]
  • [3] [Anonymous], 2011, P ACM 2011 C COMP SU, DOI DOI 10.1145/1958824.1958830
  • [4] [Anonymous], 2015, IEEE INT WORKSH MULT
  • [5] Spatio-Temporal and Events Based Analysis of Topic Popularity in Twitter
    Ardon, Sebastien
    Bagchi, Amitabha
    Mahanti, Anirban
    Ruhela, Amit
    Seth, Aaditeshwar
    Tripathy, Rudra Mohan
    Triukose, Sipat
    [J]. PROCEEDINGS OF THE 22ND ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT (CIKM'13), 2013, : 219 - 228
  • [6] Banerjee A., 2004, KDD, P509, DOI DOI 10.1145/1014052.1014111
  • [7] Banerjee A, 2007, J MACH LEARN RES, V8, P1919
  • [8] Bao B.-K., 2013, Proceedings of the International Conference on Multimedia Retrieval, P135
  • [9] Cross-Platform Emerging Topic Detection and Elaboration from Multimedia Streams
    Bao, Bing-Kun
    Xu, Changsheng
    Min, Weiqing
    Hossain, Mohammod Shamim
    [J]. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2015, 11 (04) : 1 - 21
  • [10] Summarizing video sequence using a graph-based hierarchical approach
    Belo, Luciana dos Santos
    Caetano, Carlos Antonio, Jr.
    do Patrocinio, Zenilton Kleber Goncalves, Jr.
    Ferzoli Guimaraes, Silvio Jamil
    [J]. NEUROCOMPUTING, 2016, 173 : 1001 - 1016