Information-theoretic sensor planning for large-scale production surveillance via deep reinforcement learning

被引:5
作者
Tewari, Ashutosh [1 ]
Liu, Kuang-Hung [1 ]
Papageorgiou, Dimitri [1 ]
机构
[1] ExxonMobil Res & Engn Co, 1545 US 22, Annandale, NJ 08801 USA
关键词
Active sensing; Deep reinforcement learning; Markov decision process; Production surveillance; Sensor resource management;
D O I
10.1016/j.compchemeng.2020.106988
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Production surveillance is the task of monitoring oil and gas production from every well in a hydrocarbon field. Accurate surveillance is a basic necessity for several reasons that include improved resource management, better equipment health monitoring, reduced operational cost, and ultimately optimal hydrocarbon production. A key challenge in this task, especially for large fields with many wells, is the measurement of multiphase fluid flow using a limited number of noisy sensors of varying characteristics. Current surveillance practices are based on fixed utilization schedules of such flow sensors, which rarely change over time. Such a passive mode of sensing is completely agnostic to surveillance performance and thus often fails to achieve a desired accuracy. Here we propose an active surveillance approach, underpinned by the concept of value of information-based sensing. Borrowing some well-known concepts from Markov decision processes, reinforcement learning and artificial neural networks, we demonstrate that a practical active surveillance strategy can be devised, which can not only improve surveillance performance significantly, but also reduce usage of flow sensors. (C) 2020 Published by Elsevier Ltd.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] LiDAR-Based End-to-End Active SLAM Using Deep Reinforcement Learning in Large-Scale Environments
    Chen, Jiaying
    Wu, Keyu
    Hu, Minghui
    Suganthan, Ponnuthurai Nagaratnam
    Makur, Anamitra
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (10) : 14187 - 14200
  • [42] Large-scale dynamic surgical scheduling under uncertainty by hierarchical reinforcement learning
    Zhao, Lixiang
    Zhu, Han
    Zhang, Min
    Tang, Jiafu
    Wang, Yu
    INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 2024,
  • [43] Sensor-based Mobile Robot Navigation via Deep Reinforcement Learning
    Han, Seungho-Ho
    Choi, Ho-Jin
    Benz, Philipp
    Loaiciga, Jorge
    2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP), 2018, : 147 - 154
  • [44] Traffic Signal Control for Large-Scale Road Networks Based on Deep Reinforcement with PSR
    Zhou, Zhicheng
    Zhang, Hui
    Zhang, Ya
    2024 3RD CONFERENCE ON FULLY ACTUATED SYSTEM THEORY AND APPLICATIONS, FASTA 2024, 2024, : 848 - 853
  • [45] Deep reinforcement learning driven inspection and maintenance planning under incomplete information and constraints
    Andriotis, C. P.
    Papakonstantinou, K. G.
    RELIABILITY ENGINEERING & SYSTEM SAFETY, 2021, 212
  • [46] Distributed Age-of-Information Scheduling With NOMA via Deep Reinforcement Learning
    Zhang, Congwei
    Zou, Yifei
    Zhang, Zuyuan
    Yu, Dongxiao
    Gomez, Jorge Torres
    Lan, Tian
    Dressler, Falko
    Cheng, Xiuzhen
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2025, 24 (01) : 30 - 44
  • [47] Overhead line path planning based on deep reinforcement learning and geographical information system
    Chen, Jiahui
    Yang, Yi
    Peng, Ling
    Yang, Lina
    Han, Yinhui
    Ge, Xingtong
    INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2025, 165
  • [48] Adaptive disassembly sequence planning for VR maintenance training via deep reinforcement learning
    Mao, Haoyang
    Liu, Zhenyu
    Qiu, Chan
    INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2023, 124 (09) : 3039 - 3048
  • [49] Adaptive disassembly sequence planning for VR maintenance training via deep reinforcement learning
    Haoyang Mao
    Zhenyu Liu
    Chan Qiu
    The International Journal of Advanced Manufacturing Technology, 2023, 124 : 3039 - 3048
  • [50] Automatic inverse treatment planning of Gamma Knife radiosurgery via deep reinforcement learning
    Liu, Yingzi
    Shen, Chenyang
    Wang, Tonghe
    Zhang, Jiahan
    Yang, Xiaofeng
    Liu, Tian
    Kahn, Shannon
    Shu, Hui-Kuo
    Tian, Zhen
    MEDICAL PHYSICS, 2022, 49 (05) : 2877 - 2889