Category · 1.2k presentations
Category · 3.8k presentations
Category · 14.8k presentations
Category · 491 presentations
Category · 1.3k presentations
Category · 529 presentations
Category · 3.3k presentations
Category · 599 presentations
Jul 24, 2023
Speaker · 0 followers
Speaker · 0 followers
Speaker · 0 followers
Speaker · 0 followers
Speaker · 0 followers
Speaker · 0 followers
Diffusion models feature high sample quality, but are not effective at learning semantically meaningful latent representations. Here, we propose InfoDiffusion, an algorithm that enables diffusion models to perform representation learning using low-dimensional latent variables. We introduce auxiliary-variable diffusion models—a model family that contains an additional set of semantically meaningful latents—and we derive new variational inference algorithms that optimize a learning objective regularized with a mutual information term. Maximizing mutual information helps InfoDiffusion uncover semantically meaningful representations across multiple datasets, including representations that achieve the strong property of disentanglement. We envision our methods being useful in applications that require exploring a learned latent space to generate high-quality outputs, e.g., in generative design.Diffusion models feature high sample quality, but are not effective at learning semantically meaningful latent representations. Here, we propose InfoDiffusion, an algorithm that enables diffusion models to perform representation learning using low-dimensional latent variables. We introduce auxiliary-variable diffusion models—a model family that contains an additional set of semantically meaningful latents—and we derive new variational inference algorithms that optimize a learning objective regul…
Professional recording and live streaming, delivered globally.
Presentations on similar topic, category or speaker
Zifeng Wang, …
Bradley Knox, …
Yunlong Hou, …
Yan Xu, …