Reinforcement Learning-based Energy Storage System Control for Optimal Virtual Power Plant Operation
In this paper, we design a framework of the energy storage system (ESS) controller in virtual power plant (VPP) that maximize the profit. We consider the VPP that includes photovoltaics, wind turbines and demand along with ESSs and describe the environment based on Markov decision process (MDP). To find the best policy for ESS charging and discharging control, we implement a deep Q-network (DQN) method that trains a neural network which estimates Q-function values for each possible discrete actions. In the numerical test utilizing real-world data of Namgwangju Station, ERCOT and US government, we train the DQN and demonstrate that the proposed algorithm converges. Through the test with the trained policy, we showcase that the policy functions effectively in the scenario with uncertainty from renewable generations and load, as it responds adaptively to electricity prices.
가상발전소 최적 운영을 위한 강화학습 기반 에너지 저장장치 제어
Reinforcement Learning-based Energy Storage System Control for Optimal Virtual Power Plant Operation
In this paper, we design a framework of the energy storage system (ESS) controller in virtual power plant (VPP) that maximize the profit. We consider the VPP that includes photovoltaics, wind turbines and demand along with ESSs and describe the environment based on Markov decision process (MDP). To find the best policy for ESS charging and discharging control, we implement a deep Q-network (DQN) method that trains a neural network which estimates Q-function values for each possible discrete actions. In the numerical test utilizing real-world data of Namgwangju Station, ERCOT and US government, we train the DQN and demonstrate that the proposed algorithm converges. Through the test with the trained policy, we showcase that the policy functions effectively in the scenario with uncertainty from renewable generations and load, as it responds adaptively to electricity prices.
저널 정보
대한전기학회
전기학회논문지 학술저널
전기학회논문지 제72권 제11호
2023.11 1,586 - 1,592 (7page)
DOI : 10.5370/KIEE.2023.72.11.1586
바로가기
저자
권경빈 (RaonFriends)
박종영 (Korea Railroad Research Institute)
정호성 (Korea Railroad Research Institute)
홍수민 (RaonFriends)
허재행 (RaonFriends)