One Size Fits All: Can We Train One Denoiser for All Noise Levels?

Jul 12, 2020



When using deep neural networks for estimating signals such as denoising images, it is generally preferred to train one network and apply it to all noise levels. The de facto training protocol to achieve this goal is to train the network with noisy samples whose noise levels are uniformly distributed across the range of interest. However, why should we allocate the samples uniformly? Can we have more training samples that are less noisy, and fewer samples that are more noisy? What is the optimal distribution? How do we obtain such optimal distribution? The goal of this paper is to address these questions. In particular, we show that the sampling problem can be formulated as a minimax risk optimization. We show that, although the neural networks are non-convex, the minimax problem itself is convex. We derive a dual ascent algorithm to determine the optimal distribution of which the convergence is guaranteed. We show that the framework is general not only to denoising but any trainable estimators where there is a range of uncertainty conditions. We demonstrate applications in image denoising, low-light reconstruction, and super-resolution.



About ICML 2020

The International Conference on Machine Learning (ICML) is the premier gathering of professionals dedicated to the advancement of the branch of artificial intelligence known as machine learning. ICML is globally renowned for presenting and publishing cutting-edge research on all aspects of machine learning used in closely related areas like artificial intelligence, statistics and data science, as well as important application areas such as machine vision, computational biology, speech recognition, and robotics. ICML is one of the fastest growing artificial intelligence conferences in the world. Participants at ICML span a wide range of backgrounds, from academic and industrial researchers, to entrepreneurs and engineers, to graduate students and postdocs.

Store presentation

Should this presentation be stored for 1000 years?

How do we store presentations

Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%


Recommended Videos

Presentations on similar topic, category or speaker