A framework based on Natural Language Processing and Machine Learning for the classification of the severity of road accidents from reports

被引:4
作者
Valcamonico, Dario [1 ]
Baraldi, Piero [1 ,4 ]
Amigoni, Francesco [2 ]
Zio, Enrico [1 ,3 ]
机构
[1] Politecn Milan, Energy Dept, Milan, Italy
[2] Politecn Milan, Dept Elect Informat & Bioengn DEIB, Milan, Italy
[3] MINES Paris PSL, Ctr Rech Risques & Crises CRC, Sophia Antipolis, France
[4] Politecn Milan, Energy Dept, Via Ponzio 34-3, I-20127 Milan, Italy
关键词
Road safety; road accident reports; Natural Language Processing; Hierarchical Dirichlet Process; Doc2Vec; Artificial Neural Networks; Decision Tree; Random Forest; INJURY SEVERITY;
D O I
10.1177/1748006X221140196
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Road safety analysis is typically performed by domain experts on the basis of the information contained in accident reports. The main challenges are the difficulty of considering a large number of reports in textual form and the subjectivity of the expert judgments contained in reports. This work develops a framework based on the combination of Natural Language Processing (NLP) and Machine Learning (ML) for the automatic classification of accidents with the final aim of assisting experts in performing road safety analyses. Two different models for the representation of the textual reports (Hierarchical Dirichlet Processes (HDPs) and Doc2vec) and three ML-based classifiers (Artificial Neural Networks (ANNs), Decision Trees (DTs) and Random Forests (RFs)) are compared. The framework is applied to a repository of road accident reports provided by the US National Highway Traffic Safety Administration. The best trade-off between accuracy of the classification and explainability of the obtained results is achieved by combining HDP topic modeling and RF classification.
引用
收藏
页码:903 / +
页数:186
相关论文
共 65 条
[1]  
Alghamdi R, 2015, INT J ADV COMPUT SC, V6, P147
[2]  
Almeida F., 2019, Word embeddings: A survey, Vabs/1901.09069
[3]   Probabilistic models of information retrieval based on measuring the divergence from randomness [J].
Amati, G ;
Van Rijsbergen, CJ .
ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2002, 20 (04) :357-389
[4]  
[Anonymous], 2011, Proceedings of the 22nd International Joint Conference on Artificial Intelligence, DOI DOI 10.5591/978-1-57735-516-8/IJCAI11-298
[5]  
Augenstein Jeffrey, 2003, Annu Proc Assoc Adv Automot Med, V47, P561
[6]  
Baraldi P., 2011, INT J PERFORM ENG, V7, P43
[7]  
Bengio Y, 2001, ADV NEUR IN, V13, P932
[8]  
Bezerra, 2020, P 30 EUROPEAN SAFETY, DOI [10.3850/981-973-0000-00-0, DOI 10.3850/981-973-0000-00-0]
[9]  
Bin C, 2017, CHIN AUTOM CONGR, P6907, DOI 10.1109/CAC.2017.8244022
[10]  
Blei D., 2006, Adv. Neural Inf. Process. Syst, V18, P147