Deep Reinforcement Learning Based Data-Driven Mapping Mechanism of Digital Twin for Internet of Energy

被引:2
作者
Xu, Siyu [1 ]
Guan, Xin [1 ]
Peng, Yu [2 ]
Liu, Yang [1 ]
Cui, Chen [1 ]
Chen, Hongyang [3 ]
Ohtsuki, Tomoaki [4 ]
Han, Zhu [5 ,6 ]
机构
[1] Heilongjiang Univ, Sch Data Sci & Technol, Harbin 150080, Peoples R China
[2] Heilongjiang Univ, State Grid Heilongjiang Elect Power Co Ltd, Harbin 150080, Peoples R China
[3] Zhejiang Lab, Hangzhou 311121, Peoples R China
[4] Keio Univ, Dept Informat & Comp Sci, Yokohama 2238522, Japan
[5] Univ Houston, Dept Elect & Comp Engn, Houston, TX 77004 USA
[6] Kyung Hee Univ, Dept Comp Sci & Engn, Seoul 446701, South Korea
来源
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING | 2024年 / 11卷 / 04期
关键词
Sensors; Real-time systems; Digital twins; Data models; Adaptation models; Monitoring; Sampling methods; Adaptive data mapping; deep reinforcement learning; digital twin; Markov decision process;
D O I
10.1109/TNSE.2024.3390797
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Digital twin technology can be used in the internet of energy (IoE) systems to perform physical objects optimization and decision-making by updating relevant models in real-time. Model update is performed using real-time data generated by multiple devices contained in an IoE system. Since volume of the real-time data generated by IoE system is big, it is difficult for digital twin models to map the real-time data into virtual space. The difficulty of data mapping is because of high data volume and high resource consumption. In this paper, an adaptive data mapping mechanism using deep reinforcement learning (DRL) technique is devised. The proposed mechanism can dynamically adjust mapping data selection according to the environmental state and user requirements. By dynamically adjusting mapping data selection, the data and resource consumption used for mapping can be effectively reduced. The experimental results validate that the proposed mechanism can perform dynamic mapping data selection with reduced mapping data and low resource consumption.
引用
收藏
页码:3876 / 3890
页数:15
相关论文
共 31 条
[1]   Digital Twin Conceptual Model within the Context of Internet of Things [J].
Al-Ali, A. R. ;
Gupta, Ragini ;
Zaman Batool, Tasneem ;
Landolsi, Taha ;
Aloul, Fadi ;
Al Nabulsi, Ahmad .
FUTURE INTERNET, 2020, 12 (10) :1-15
[2]   On adaptive sampling algorithms for IoT devices [J].
Ben-Aboud, Yassine ;
Licea, Daniel Bonilla ;
Ghogho, Mounir ;
Kobbane, Abdellatif .
IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,
[3]   Time Series Data Analysis of Wireless Sensor Network Measurements of Temperature [J].
Bhandari, Siddhartha ;
Bergmann, Neil ;
Jurdak, Raja ;
Kusy, Branislav .
SENSORS, 2017, 17 (06)
[4]   Trading Private Range Counting over Big IoT Data [J].
Cai, Zhipeng ;
He, Zaobo .
2019 39TH IEEE INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS 2019), 2019, :144-153
[5]  
Chatterjea S, 2008, LECT NOTES COMPUT SC, V5067, P60, DOI 10.1007/978-3-540-69170-9_5
[6]  
Cheng SY, 2013, IEEE INFOCOM SER, P3084
[7]   Scaling Configuration of Energy Harvesting Sensors with Reinforcement Learning [J].
Fraternali, Francesco ;
Balaji, Bharathan ;
Gupta, Rajesh .
PROCEEDINGS OF THE 2018 INTERNATIONAL WORKSHOP ON ENERGY HARVESTING & ENERGY-NEUTRAL SENSING SYSTEMS (ENSSYS '18), 2018, :7-13
[8]  
Jain A., 2004, Proceedings of the 37th Annual Hawaii International Conference on System Sciences, DOI 10.1145/1052199.1052202
[9]   Building blocks for a digital twin of additive manufacturing [J].
Knapp, G. L. ;
Mukherjee, T. ;
Zuback, J. S. ;
Wei, H. L. ;
Palmer, T. A. ;
De, A. ;
DebRoy, T. .
ACTA MATERIALIA, 2017, 135 :390-399
[10]   Dynamic Evaluation Method of Machining Process Planning Based on Digital Twin [J].
Liu, Jinfeng ;
Zhou, Honggen ;
Liu, Xiaojun ;
Tian, Guizhong ;
Wu, Mingfang ;
Cao, Liping ;
Wang, Wei .
IEEE ACCESS, 2019, 7 :19312-19323