Social media data analysis framework for disaster response

被引:0
作者
Ponce-López V. [1 ]
Spataru C. [1 ]
机构
[1] UCL Energy Institute, University College London, London
来源
Discover Artificial Intelligence | 2022年 / 2卷 / 01期
基金
巴西圣保罗研究基金会; 英国科研创新办公室; 日本科学技术振兴机构;
关键词
Disaster response; Machine learning; Message filtering framework; Text analysis;
D O I
10.1007/s44163-022-00026-4
中图分类号
学科分类号
摘要
This paper presents a social media data analysis framework applied to multiple datasets. The method developed uses machine learning classifiers, where filtering binary classifiers based on deep bidirectional neural networks are trained on benchmark datasets of disaster responses for earthquakes and floods and extreme flood events. The classifiers consist of learning from discrete handcrafted features and fine-tuning approaches using deep bidirectional Transformer neural networks on these disaster response datasets. With the development of the multiclass classification approach, we compare the state-of-the-art results in one of the benchmark datasets containing the largest number of disaster-related categories. The multiclass classification approaches developed in this research with support vector machines provide a precision of 0.83 and 0.79 compared to Bernoulli naïve Bayes, which are 0.59 and 0.76, and multinomial naïve Bayes, which are 0.79 and 0.91, respectively. The binary classification methods based on the MDRM dataset show a higher precision with deep learning methods (DistilBERT) than BoW and TF-IDF, while in the case of UnifiedCEHMET dataset show a high performance for accuracy with the deep learning method in terms of severity, with a precision of 0.92 compared to BoW and TF-IDF method which has a precision of 0.68 and 0.70, respectively. © The Author(s) 2022.
引用
收藏
相关论文
共 41 条
  • [1] Leaning J., Debarati G.S., Natural disasters, armed conflict, and public health, New Engl J Med Public Health, 369, 19, pp. 1836-1842, (2013)
  • [2] Landwehr P.M., Carley K.M., Social media in disaster relief: usage patterns, data mining tools, and current research directions," data mining and knowledge discovery for big data, Studies in Big Data, 1, pp. 225-257, (2014)
  • [3] Niles M.T., Emery B.F., Reagan A.J., Dodds P.S., Danforth C.M., Social media usage patterns during natural hazards, PLoS ONE, 14, 2, pp. 1-16, (2019)
  • [4] CEH, UK Centre for Ecology & Hydrology
  • [5] Metoffice, UK Meteorological Office
  • [6] Department of Homeland Security (DHS), Innovative Uses of Social Media in Emergency Management: System Assessment and Validation for Emergency Responders (SAVER), (2013)
  • [7] Tools and Methods for Estimating Populations at Risk from Natural Disasters and Complex Humanitarian Crises, Washington, (2007)
  • [8] Poblet M., Garcia-Cuesta E., Casanovas P., Crowdsourcing tools for disaster management: A review of platforms and methods, International Workshop on AI Approaches to the Complexity of Legal Systems, (2013)
  • [9] CHS Alliance, 2018.
  • [10] Ozcan S., Tweet-Preprocessor