Automated Disaster Monitoring From Social Media Posts Using AI-Based Location Intelligence and Sentiment Analysis

被引:60
作者
Sufi, Fahim K. [1 ]
Khalil, Ibrahim [2 ]
机构
[1] Fed Govt, Melbourne, Vic 3000, Australia
[2] RMIT Univ, Sch CS & IT, Melbourne, Vic 3000, Australia
关键词
Social networking (online); Sentiment analysis; Feature extraction; Monitoring; Earthquakes; Deep learning; Support vector machines; AI-based disaster monitoring dashboard; artificial intelligence (AI); automated location extraction; disaster intelligence mobile app; named entity recognition (NER); sentiment analysis; ABUSE;
D O I
10.1109/TCSS.2022.3157142
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Worldwide disasters like bushfires, earthquakes, floods, cyclones, and heatwaves have affected the lives of social media users in an unprecedented manner. They are constantly posting their level of negativity over the disaster situations at their location of interest. Understanding location-oriented sentiments about disaster situation is of prime importance for political leaders, and strategic decision-makers. To this end, we present a new fully automated algorithm based on artificial intelligence (AI) and natural language processing (NLP), for extraction of location-oriented public sentiments on global disaster situation. We designed the proposed system to obtain exhaustive knowledge and insights on social media feeds related to disaster in 110 languages through AI- and NLP-based sentiment analysis, named entity recognition (NER), anomaly detection, regression, and Getis Ord Gi* algorithms. We deployed and tested this algorithm on live Twitter feeds from 28 September to 6 October 2021. Tweets with 67 515 entities in 39 different languages were processed during this period. Our novel algorithm extracted 9727 location entities with greater than 70% confidence from live Twitter feed and displayed the locations of possible disasters with disaster intelligence. The rates of average precision, recall, and F ₁-Score were measured to be 0.93, 0.88, and 0.90, respectively. Overall, the fully automated disaster monitoring solution demonstrated 97% accuracy. To the best of our knowledge, this study is the first to report location intelligence with NER, sentiment analysis, regression and anomaly detection on social media messages related to disasters and has covered the largest set of languages.
引用
收藏
页码:4614 / 4624
页数:11
相关论文
共 38 条
[21]   Mapping Consumer Sentiment Toward Wireless Services Using Geospatial Twitter Data [J].
Qi, Weijie ;
Procter, Rob ;
Zhang, Jie ;
Guo, Weisi .
IEEE ACCESS, 2019, 7 :113726-113739
[22]   Landslide Inventory (2001-2017) of Chittagong Hilly Areas, Bangladesh [J].
Rabby, Yasin Wahid ;
Li, Yingkui .
DATA, 2020, 5 (01)
[23]   Time-Series Anomaly Detection Service at Microsoft [J].
Ren, Hansheng ;
Xu, Bixiong ;
Wang, Yujing ;
Yi, Chao ;
Huang, Congrui ;
Kou, Xiaoyu ;
Xing, Tony ;
Yang, Mao ;
Tong, Jie ;
Zhang, Qi .
KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, :3009-3017
[24]   Extracting and Summarizing Situational Information from the Twitter Social Media during Disasters [J].
Rudra, Koustav ;
Ganguly, Niloy ;
Goyal, Pawan ;
Ghosh, Saptarshi .
ACM TRANSACTIONS ON THE WEB, 2018, 12 (03)
[25]   Tweet Analysis for Real-Time Event Detection and Earthquake Reporting System Development [J].
Sakaki, Takeshi ;
Okazaki, Makoto ;
Matsuo, Yutaka .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2013, 25 (04) :919-931
[26]  
Statista, 2021, COST NAT DIS LOSS WO
[27]  
Sufi F., 2021, IEEE DATAPORT, DOI [10.21227/p0-d-cb23, DOI 10.21227/P0-D-CB23]
[28]   AI-GlobalEvents: A Software for analyzing, identifying and explaining global events with Artificial Intelligence [J].
Sufi, Fahim K. .
SOFTWARE IMPACTS, 2022, 11
[29]   AI-Landslide: Software for acquiring hidden insights from global landslide data using Artificial Intelligence [J].
Sufi, Fahim K. .
SOFTWARE IMPACTS, 2021, 10
[30]   Automated Multidimensional Analysis of Global Events With Entity Detection, Sentiment Analysis and Anomaly Detection [J].
Sufi, Fahim K. ;
Alsulami, Musleh .
IEEE ACCESS, 2021, 9 :152449-152460