Learn to Bid: Deep Reinforcement Learning with Transformer for Energy Storage Bidding in Energy and Contingency Reserve Markets
Dec 2, 2022
Speakers
Changlong Wang
Speaker · 0 followers
Yanru Zhang
Speaker · 0 followers
About
As part of efforts to tackle climate change, grid-scale battery energy storage systems (BESS) play an essential role in facilitating reliable and secure power system operation with variable renewable energy (VRE). BESS can balance time-varying electricity demand and supply in the spot market through energy arbitrage and in the frequency control ancillary services (FCAS) market through service enablement or delivery. Effective algorithms are needed for the optimal participation of BESS in multiple markets. Using deep reinforcement learning (DRL), we present a BESS bidding strategy in the joint spot and contingency FCAS markets, leveraging a transformer-based temporal feature extractor to exploit the temporal trends of volatile energy prices. We validate our strategy on real-world historical energy prices in the Australian National Electricity Market (NEM). We demonstrate that the novel DRL-based bidding strategy significantly outperforms benchmarks. The simulation also reveals that the joint bidding in both the spot and contingency FCAS markets can yield a much higher profit than in individual markets and even profits combined in some jurisdictions of the Australian NEM. Our work provides a viable use case for the BESS, contributing to the power system operation with high penetration of renewables.As part of efforts to tackle climate change, grid-scale battery energy storage systems (BESS) play an essential role in facilitating reliable and secure power system operation with variable renewable energy (VRE). BESS can balance time-varying electricity demand and supply in the spot market through energy arbitrage and in the frequency control ancillary services (FCAS) market through service enablement or delivery. Effective algorithms are needed for the optimal participation of BESS in multipl…
Organizer
NeurIPS 2022
Account · 961 followers
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
Adversarially Robust Learning: A Generic Minimax Optimal Learner and Characterization
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
CAREER: Economic Prediction of Labor Sequence Data Under Distribution Shift
Watch later
Keyon Vafa, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Causal Analysis of the TOPCAT Trial: Spironolactone for Preserved Cardiac Function Heart Failure
Watch later
Total of 1 viewers voted for saving the presentation to eternal vault which is 0.1%
Towards Theoretically Inspired Neural Initialization Optimization
Watch later
Yibo Yang, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Sample Constrained Treatment Effect Estimation
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
![[Re] Differentiable Spatial Planning using Transformers](https://ma.slideslive.com/library/presentations/38992715/thumbnail/re-differentiable-spatial-planning-using-transformers_Ssx2LN_small.jpg)
[Re] Differentiable Spatial Planning using Transformers
Watch later
Rohit Ranjan, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%