MMD Aggregated Two-Sample Test
Dec 10, 2023
Speakers
Antonin Schrab
Speaker · 0 followers
Mélisande Albert
Speaker · 0 followers
Béatrice Laurent
Speaker · 0 followers
Benjamin Guedj
Speaker · 0 followers
Arthur Gretton
Speaker · 8 followers
About
We propose two novel nonparametric two-sample kernel tests based on the Maximum Mean Discrepancy (MMD). First, for a fixed kernel, we construct an MMD test using either permutations or a wild bootstrap, two popular numerical procedures to determine the test threshold. We prove that this test controls the probability of type I error non-asymptotically. Hence, it can be used reliably even in settings with small sample sizes as it remains well-calibrated, which differs from previous MMD tests which only guarantee correct test level asymptotically. When the difference in densities lies in a Sobolev ball, we prove minimax optimality of our MMD test with a specific kernel depending on the smoothness parameter of the Sobolev ball. In practice, this parameter is unknown and, hence, the optimal MMD test with this particular kernel cannot be used. To overcome this issue, we construct an aggregated test, called MMDAgg, which is adaptive to the smoothness parameter. The test power is maximised over the collection of kernels used, without requiring held-out data for kernel selection (which results in a loss of test power), or arbitrary kernel choices such as the median heuristic. We prove that MMDAgg still controls the level non-asymptotically, and achieves the minimax rate over Sobolev balls, up to an iterated logarithmic term. Our guarantees are not restricted to a specific type of kernel, but hold for any product of one-dimensional translation invariant characteristic kernels. We provide a user-friendly parameter-free implementation of MMDAgg using an adaptive collection of bandwidths. We demonstrate that MMDAgg significantly outperforms alternative state-of-the-art MMD-based two-sample tests on synthetic data satisfying the Sobolev smoothness assumption, and that, on real-world image data, MMDAgg closely matches the power of tests leveraging the use of models such as neural networks.We propose two novel nonparametric two-sample kernel tests based on the Maximum Mean Discrepancy (MMD). First, for a fixed kernel, we construct an MMD test using either permutations or a wild bootstrap, two popular numerical procedures to determine the test threshold. We prove that this test controls the probability of type I error non-asymptotically. Hence, it can be used reliably even in settings with small sample sizes as it remains well-calibrated, which differs from previous MMD tests which…
Organizer
NeurIPS 2023
Account · 645 followers
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
Advancing Privacy and Dataset Augmentation in Medical and Chart Data Using AI-Driven Image Editing
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Koopman Kernel Regression
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Rain AI - Precipitation Nowcasting from Satellite Data
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Network Regression with Graph Laplacian
Watch later
Yidong Zhou, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Experimental Designs for Heteroskedastic Variance
Watch later
Justin Weltz, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Models
Watch later
Weijian Luo, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%