24. července 2023
Sprecher:in · 0 Follower:innen
Sprecher:in · 1 Follower:in
Sprecher:in · 0 Follower:innen
Neural network approaches for meta-learning distributions over functions have desirable properties such as increased flexibility and reduced inference computational complexity. Building on the successes of denoising diffusion models for generative modelling, we propose Neural Diffusion Processes (NDPs), a novel approach that learns to sample from a rich distribution over functions. By introducing a novel attention block we are able to incorporate properties of stochastic processes, such as exchangeability, directly into the NDP's architecture. We empirically show that NDPs can capture functional distributions close to the true Bayesian posterior, demonstrating that they can successfully emulate the behaviour of Gaussian processes and surpass the performance of neural processes. NDPs enable a variety of downstream tasks, including hyperparameter marginalisation, non-Gaussian posterior prediction and global optimisation.Neural network approaches for meta-learning distributions over functions have desirable properties such as increased flexibility and reduced inference computational complexity. Building on the successes of denoising diffusion models for generative modelling, we propose Neural Diffusion Processes (NDPs), a novel approach that learns to sample from a rich distribution over functions. By introducing a novel attention block we are able to incorporate properties of stochastic processes, such as excha…
Profesionální natáčení a streamování po celém světě.
Prezentace na podobné téma, kategorii nebo přednášejícího
Hongxin Wei, …
Rudrajit Das, …