DRL-EPANET: Deep reinforcement learning for optimal control at scale in Water Distribution Systems
Dec 2, 2022
Speakers
Anas Belfadil
Speaker · 0 followers
David Modesto
Speaker · 0 followers
Jose Martin H.
Speaker · 0 followers
About
Deep Reinforcement learning has known a revolution in recent years, it has allowed researchers to tackle a wide range of sequential decision problems that were inaccessible to previous methods. However, the use of this technique in Water Distribution Systems is still very shy. In this paper, we show that DRL can be coupled with the widely popular hydraulic simulator Epanet, and that DRL-Epanet can be used on a number of WDS problems that represent a challenge to current techniques. We take as a concrete example the problem of pressure control in WDS. We show that DRL-Epanet can scale to huge action spaces, and we demonstrate its effectiveness on a problem with more than 1 million possible actions at each time step. We also show that it can deal with uncertainty such as stochastic demands, contamination, or other risks, as an example, we take on the problem of pressure control in the presence of random pipe bursts. We show that the BDQ algorithm is able to learn in this setting and we improve it with an algorithmic modification BDQF (BDQ with Fixed actions) which achieves better rewards especially when allowed actions are sparse in the action space. Finally, we argue that DRL-Epanet can be used for real-time control in smart WDS, another advantage over current methods.Deep Reinforcement learning has known a revolution in recent years, it has allowed researchers to tackle a wide range of sequential decision problems that were inaccessible to previous methods. However, the use of this technique in Water Distribution Systems is still very shy. In this paper, we show that DRL can be coupled with the widely popular hydraulic simulator Epanet, and that DRL-Epanet can be used on a number of WDS problems that represent a challenge to current techniques. We take as a…
Organizer
NeurIPS 2022
Account · 961 followers
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
A Variant of Anderson Mixing with Minimal Memory Size
Watch later
Fuchao Wei, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Towards A Unified Policy Abstraction Theory and Representation Learning Approach in Markov Decision Processes
Watch later
Min Zhang, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Cyclophobic Reinforcement Learning
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Time-Conditioned Dances with Simplicial Complexes: Zigzag Filtration Curve based Supra-Hodge Convolution Networks for Time-series Forecasting
Watch later
Yuzhou Chen, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Amortized Projection Optimization for Sliced Wasserstein Generative Models
Watch later
Khai Nguyen, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Constrained Predictive Coding as a Biologically Plausible Model of the Cortical Hierarchy
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%