SocialTERM-Extractor: Identifying and Predicting Social-Problem-Specific Key Noun Terms from a Large Number of Online News Articles Using Text Mining and Machine Learning Techniques

被引:8
作者
Suh, Jong Hwan [1 ]
机构
[1] Gyeongsang Natl Univ, BERI, Dept Management Informat Syst, 501 Jinjudae Ro, Jinju Si 52828, Gyeongsangnam D, South Korea
基金
新加坡国家研究基金会;
关键词
social-problem-specific key noun terms; temporal weights; sentiment analysis; complex network structure analysis; deep learning; ensemble learning methods; SENTIMENT CLASSIFICATION; INFORMATION; COMMUNITIES; TECHNOLOGY; DIVERSITY; STRATEGY; NETWORKS; PATTERNS; SCIENCE; SYSTEMS;
D O I
10.3390/su11010196
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
In the digital age, the abundant unstructured data on the Internet, particularly online news articles, provide opportunities for identifying social problems and understanding social systems for sustainability. However, the previous works have not paid attention to the social-problem-specific perspectives of such big data, and it is currently unclear how information technologies can use the big data to identify and manage the ongoing social problems. In this context, this paper introduces and focuses on social-problem-specific key noun terms, namely SocialTERMs, which can be used not only to search the Internet for social-problem-related data, but also to monitor the ongoing and future events of social problems. Moreover, to alleviate time-consuming human efforts in identifying the SocialTERMs, this paper designs and examines the SocialTERM-Extractor, which is an automatic approach for identifying the key noun terms of social-problem-related topics, namely SPRTs, in a large number of online news articles and predicting the SocialTERMs among the identified key noun terms. This paper has its novelty as the first trial to identify and predict the SocialTERMs from a large number of online news articles, and it contributes to literature by proposing three types of text-mining-based features, namely temporal weight, sentiment, and complex network structural features, and by comparing the performances of such features with various machine learning techniques including deep learning. Particularly, when applied to a large number of online news articles that had been published in South Korea over a 12-month period and mostly written in Korean, the experimental results showed that Boosting Decision Tree gave the best performances with the full feature sets. They showed that the SocialTERMs can be predicted with high performances by the proposed SocialTERM-Extractor. Eventually, this paper can be beneficial for individuals or organizations who want to explore and use social-problem-related data in a systematical manner for understanding and managing social problems even though they are unfamiliar with ongoing social problems.
引用
收藏
页数:44
相关论文
共 86 条
  • [81] Gender Classification for Web Forums
    Zhang, Yulei
    Dang, Yan
    Chen, Hsinchun
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART A-SYSTEMS AND HUMANS, 2011, 41 (04): : 668 - 677
  • [82] Topic oriented community detection through social objects and link analysis in social networks
    Zhao, Zhongying
    Feng, Shengzhong
    Wang, Qiang
    Huang, Joshua Zhexue
    Williams, Graham J.
    Fan, Jianping
    [J]. KNOWLEDGE-BASED SYSTEMS, 2012, 26 : 164 - 173
  • [83] Questioner or question: Predicting the response rate in social question and answering on Sina Weibo
    Zhe, Liu
    Jansen, Bernard J.
    [J]. INFORMATION PROCESSING & MANAGEMENT, 2018, 54 (02) : 159 - 174
  • [84] Incorporating appraisal expression patterns into topic modeling for aspect and sentiment word identification
    Zheng, Xiaolin
    Lin, Zhen
    Wang, Xiaowei
    Lin, Kwei-Jay
    Song, Meina
    [J]. KNOWLEDGE-BASED SYSTEMS, 2014, 61 : 29 - 47
  • [85] Zhou Z, 2012, CHAPMAN HALL SERIES, V1, P236
  • [86] Finding story chains in newswire articles using random walks
    Zhu, Xianshu
    Oates, Tim
    [J]. INFORMATION SYSTEMS FRONTIERS, 2014, 16 (05) : 753 - 769