Tutorial on normalizing flows
Jun 15, 2019
About
Invertible neural networks have been a significant thread of research in the ICML community for several years. Such transformations can offer a range of unique benefits: (1) They preserve information, allowing perfect reconstruction (up to numerical limits) and obviating the need to store hidden activations in memory for backpropagation. (2) They are often designed to track the changes in probability density that applying the transformation induces (as in normalizing flows). (3) Like autoregressive models, normalizing flows can be powerful generative models which allow exact likelihood computations; with the right architecture, they can also allow for much cheaper sampling than autoregressive models. While many researchers are aware of these topics and intrigued by several high-profile papers, few are familiar enough with the technical details to easily follow new developments and contribute. Many may also be unaware of the wide range of applications of invertible neural networks, beyond generative modelling and variational inference.Invertible neural networks have been a significant thread of research in the ICML community for several years. Such transformations can offer a range of unique benefits: (1) They preserve information, allowing perfect reconstruction (up to numerical limits) and obviating the need to store hidden activations in memory for backpropagation. (2) They are often designed to track the changes in probability density that applying the transformation induces (as in normalizing flows). (3) Like autoreg…
Categories
AI & Data Science
Category · 10.8k presentations
Mathematics
Category · 2.4k presentations
About ICML 2019
The International Conference on Machine Learning (ICML) is the premier gathering of professionals dedicated to the advancement of the branch of artificial intelligence known as machine learning. ICML is globally renowned for presenting and publishing cutting-edge research on all aspects of machine learning used in closely related areas like artificial intelligence, statistics and data science, as well as important application areas such as machine vision, computational biology, speech recognition, and robotics. ICML is one of the fastest growing artificial intelligence conferences in the world. Participants at ICML span a wide range of backgrounds, from academic and industrial researchers, to entrepreneurs and engineers, to graduate students and postdocs.
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
Optimization: Convex and Non-convex
Watch later
Minimun Stein Discrepancy Estimators
Watch later
The How2 Challenge: New Tasks for Vision and Language
Watch later
Lucia Specia, …
"Ideas" mini-spotlights
Watch later
Glow: Generative Flow with Invertible 1x1 Convolutions
Watch later
