Information-theoretic sensor planning for large-scale production surveillance via deep reinforcement learning

被引:5
作者
Tewari, Ashutosh [1 ]
Liu, Kuang-Hung [1 ]
Papageorgiou, Dimitri [1 ]
机构
[1] ExxonMobil Res & Engn Co, 1545 US 22, Annandale, NJ 08801 USA
关键词
Active sensing; Deep reinforcement learning; Markov decision process; Production surveillance; Sensor resource management;
D O I
10.1016/j.compchemeng.2020.106988
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Production surveillance is the task of monitoring oil and gas production from every well in a hydrocarbon field. Accurate surveillance is a basic necessity for several reasons that include improved resource management, better equipment health monitoring, reduced operational cost, and ultimately optimal hydrocarbon production. A key challenge in this task, especially for large fields with many wells, is the measurement of multiphase fluid flow using a limited number of noisy sensors of varying characteristics. Current surveillance practices are based on fixed utilization schedules of such flow sensors, which rarely change over time. Such a passive mode of sensing is completely agnostic to surveillance performance and thus often fails to achieve a desired accuracy. Here we propose an active surveillance approach, underpinned by the concept of value of information-based sensing. Borrowing some well-known concepts from Markov decision processes, reinforcement learning and artificial neural networks, we demonstrate that a practical active surveillance strategy can be devised, which can not only improve surveillance performance significantly, but also reduce usage of flow sensors. (C) 2020 Published by Elsevier Ltd.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Optimal Scheduling of Electric Vehicle Load for Large-scale Battery Charging and Swapping Based on Deep Reinforcement Learning
    Liu D.
    Wang L.
    Wang W.
    Li H.
    Wang W.
    Liu M.
    Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2022, 46 (04): : 36 - 46
  • [32] Obstacle avoidance for environmentally-driven USVs based on deep reinforcement learning in large-scale uncertain environments
    Wang, Peng
    Liu, Ranran
    Tian, Xinliang
    Zhang, Xiantao
    Qiao, Lei
    Wang, Yuntao
    OCEAN ENGINEERING, 2023, 270
  • [33] Multi-Commodity Flow Routing for Large-Scale LEO Satellite Networks Using Deep Reinforcement Learning
    Tsai, Kai-Chu
    Fan, Lei
    Wang, Li-Chun
    Lent, Ricardo
    Han, Zhu
    2022 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2022, : 626 - 631
  • [34] Path Planning for UAV Ground Target Tracking via Deep Reinforcement Learning
    Li, Bohao
    Wu, Yunjie
    IEEE ACCESS, 2020, 8 (29064-29074) : 29064 - 29074
  • [35] Deep reinforcement learning trajectory planning for vibration suppression via jerk control
    Park, Sung Gwan
    Rhim, Sungsoo
    2023 20TH INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS, UR, 2023, : 818 - 824
  • [36] A deep reinforcement learning model for large-scale traffic signal control based on graph meta-learning using local subgraphs
    Zhou, Zhicheng
    Zhang, Ya
    Li, Xinde
    SCIENCE CHINA-INFORMATION SCIENCES, 2025, 68 (07)
  • [37] An inertial control method for large-scale wind farm based on hierarchical distributed hybrid deep-reinforcement learning
    Han, Ji
    Chen, Zhe
    JOURNAL OF CLEANER PRODUCTION, 2024, 450
  • [38] GARLSched: Generative adversarial deep reinforcement learning task scheduling optimization for large-scale high performance computing systems
    Li, Jingbo
    Zhang, Xingjun
    Wei, Jia
    Ji, Zeyu
    Wei, Zheng
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2022, 135 : 259 - 269
  • [39] GlobalLight: Exploring global influence in multi-agent deep reinforcement learning for large-scale traffic signal control
    Liu, Yilin
    Liang, Jintao
    Zhang, Yifeng
    Gong, Ping
    Luo, Guiyang
    Yuan, Quan
    Li, Jinglin
    NEUROCOMPUTING, 2025, 637
  • [40] Deep reinforcement learning assisted automated guiding vector selection for large-scale sparse multi-objective optimization
    Shao, Shuai
    Tian, Ye
    Zhang, Xingyi
    SWARM AND EVOLUTIONARY COMPUTATION, 2024, 88