Group Equivariant Subsampling
Dec 6, 2021
Speakers
Hyunjik Kim
Speaker · 0 followers
Tom Rainforth
Speaker · 0 followers
Yee Whye Teh
Speaker · 1 follower
About
Subsampling is used in convolutional neural networks (CNNs) in the form of pooling or strided convolutions, to reduce the spatial dimensions of feature maps and to allow the receptive fields to grow exponentially with depth. However, it is known that such subsampling operations are not translation equivariant, unlike convolutions that are translation equivariant. Here, we first introduce translation equivariant subsampling/upsampling layers that can be used to construct exact translation equivariant CNNs. We then generalise these layers beyond translations to general groups, thus proposing group equivariant subsampling/upsampling. We use these layers to construct group equivariant autoencoders (GAEs) that allow us to learn low-dimensional equivariant representations. We empirically verify on images that the representations are indeed equivariant to input translations and rotations, and thus generalise well to unseen positions and orientations. We further use GAEs in models that learn object-centric representations on multi-object datasets, and show improved data efficiency and decomposition compared to non-equivariant baselines.Subsampling is used in convolutional neural networks (CNNs) in the form of pooling or strided convolutions, to reduce the spatial dimensions of feature maps and to allow the receptive fields to grow exponentially with depth. However, it is known that such subsampling operations are not translation equivariant, unlike convolutions that are translation equivariant. Here, we first introduce translation equivariant subsampling/upsampling layers that can be used to construct exact translation equivar…
Organizer
NeurIPS 2021
Account · 1.9k followers
About NeurIPS 2021
Neural Information Processing Systems (NeurIPS) is a multi-track machine learning and computational neuroscience conference that includes invited talks, demonstrations, symposia and oral and poster presentations of refereed papers. Following the conference, there are workshops which provide a less formal setting.
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
Deceive D: Adaptive Pseudo Augmentation for GAN Training with Limited Data
Watch later
Liming Jiang, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
A Brief Summary on Covid-19 Pandemic & Machine Learning Approaches
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Defending the undefendable... Why I support peer reviewing
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
LatinX in AI (LXAI) Research @ NeurIPS 2021
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Hindsight Task Relabelling: Experience Replay for Sparse Reward Meta-RL
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
An analysis of Ermakov-Zolotukhin quadrature using kernels
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%