A Novel Grid Load Management Technique Using Electric Water Heaters and Q-Learning

被引:0
作者
Al-Jabery, Khalid [1 ]
Wunsch, Don C. [1 ]
Xiong, Jinjun [2 ]
Shi, Yiyu [1 ]
机构
[1] Missouri Univ Sci & Technol, ECE Dept, Rolla, MO 65401 USA
[2] IBM TJ Watson Res Ctr, Yorktown Hts, NY 10562 USA
来源
2014 IEEE INTERNATIONAL CONFERENCE ON SMART GRID COMMUNICATIONS (SMARTGRIDCOMM) | 2014年
关键词
Electric water heaters; Reinforcement learning; Markov decision process; Q-learning; grid demand;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper describes a novel technique for controlling demand-side management (DSM) by optimizing the power consumed by Domestic Electric Water Heaters (DEWH) while maintaining customer satisfaction. The system has 18 states based on three factors: instantaneous grid load, water consumption, and the temperature of the water supplied. The current state of the system is defined based on its fuzzy membership for each factor. The resulting model represents a Semi-Markov decision process (SMDP) with two possible actions, "On" and "Off." Rewards are assigned for each action-state pairs proportionally to the fuzzy membership of the system in the new state. A simulation study was conducted to compare the proposed method with three previous approaches. The proposed method demonstrated better performance in reducing the overall grid power demand and flattening its peaks. Furthermore, it provides better rate of customers' satisfaction than the uncontrolled operation.
引用
收藏
页码:776 / 781
页数:6
相关论文
共 18 条
[1]  
Bertsekas D. P., 1995, Dynamic programming and optimal control, V1
[2]  
Cardarelli Francois., 2003, Encyclopaedia of Scientific Units, Weights, and Measures: Their SI Equivalences and Origins
[3]  
Department for Environment Food and Rural Affairs, 2008, MEAS DOM HOT WAT CON
[4]  
Diduch C., 2012, Proceedings of the 2012 IEEE 7th International Power Electronics and Motion Control Conference (ECCE 2012), P128, DOI 10.1109/IPEMC.2012.6258873
[5]  
Gosavi Abhijit., 2003, OPERAT RES COMP SCI, V25
[6]  
Klemes J, 2008, WOODHEAD PUBL FOOD S, P1, DOI 10.1533/9781845694678
[7]  
Lu N, 2005, IEEE POWER ENG SOC, P202
[8]  
Lu S., 2008, PNNL17474
[9]   Control Strategy for Domestic Water Heaters during Peak Periods and its Impact on the Demand for Electricity [J].
Moreau, Alain .
PROCEEDINGS OF INTERNATIONAL CONFERENCE ON SMART GRID AND CLEAN ENERGY TECHNOLOGIES (ICSGCE 2011), 2011, 12
[10]  
Mujumdar A.S., 2006, Drying Technology, V24, P245