Scenario-Based Marine Oil Spill Emergency Response Using Hybrid Deep Reinforcement Learning and Case-Based Reasoning

被引:16
作者
Huang, Kui [1 ]
Nie, Wen [2 ]
Luo, Nianxue [1 ]
机构
[1] Wuhan Univ, Sch Geodesy & Geomat, Wuhan 430072, Peoples R China
[2] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & R, Wuhan 430072, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2020年 / 10卷 / 15期
基金
国家重点研发计划;
关键词
case-based reasoning; deep Q-network; marine oil spill; scenario; CBR;
D O I
10.3390/app10155269
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Case-based reasoning (CBR) systems often provide a basis for decision makers to make management decisions in disaster prevention and emergency response. For decades, many CBR systems have been implemented by using expert knowledge schemes to build indexes for case identification from a case library of situations and to explore the relations among cases. However, a knowledge elicitation bottleneck occurs for many knowledge-based CBR applications because expert reasoning is difficult to precisely explain. To solve these problems, this paper proposes a method using only knowledge to recognize marine oil spill cases. The proposed method combines deep reinforcement learning (DRL) with strategy selection to determine emergency responses for marine oil spill accidents by quantification of the marine oil spill scenario as the reward for the DRL agent. These accidents are described by scenarios and are considered the state inputs in the hybrid DRL/CBR framework. The challenges and opportunities of the proposed method are discussed considering different scenarios and the intentions of decision makers. This approach may be helpful in terms of developing hybrid DRL/CBR-based tools for marine oil spill emergency response.
引用
收藏
页数:16
相关论文
共 27 条
[1]   Ontology-supported case-based reasoning approach for intelligent m-Government emergency response services [J].
Amailef, Khaled ;
Lu, Jie .
DECISION SUPPORT SYSTEMS, 2013, 55 (01) :79-97
[2]  
[Anonymous], 1998, INTRO REINFORCEMENT
[3]  
Cai W., 2009, MOD P 2009 INT C COM, P1
[4]  
Chen Y., 2015, RES UNCONVENTIONAL E, V45
[5]  
Chou J.S., 2008, Tsinghua Sci. Technol, V13, P114, DOI DOI 10.1016/S1007-0214(08)70136-6
[6]  
Cornish Christopher John, 1989, (Ph.D. thesis
[7]   Emergency Response System for Pollution Accidents in Chemical Industrial Parks, China [J].
Duan, Weili ;
He, Bin .
INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH, 2015, 12 (07) :7868-7885
[8]  
Finney D. J., 1952, J AM STAT ASSOC, DOI DOI 10.2307/2280787
[9]  
Gabel T, 2005, LECT NOTES ARTIF INT, V3620, P206, DOI 10.1007/11536406_18
[10]  
Golson S, 1993, P 3 ANN PLD DES C EX, V1