An Empirical Study of Adder Neural Networks for Object Detection
Dec 6, 2021
Speakers
Xinghao Chen
Speaker · 0 followers
Minjing Dong
Speaker · 0 followers
Chunjing Xu
Speaker · 0 followers
Yunhe Wang
Speaker · 0 followers
About
Adder neural networks (AdderNets) have shown impressive performance on image classification with only addition operations, which are more energy efficient than traditional convolutional neural networks built with multiplications. Compared with classification, there is a strong demand on reducing the energy consumption of modern object detectors via AdderNets for real-world applications such as autonomous driving and face detection. In this paper, we present an empirical study of AdderNets for object detection. We first reveal that the batch normalization statistics in the pre-trained adder backbone should not be frozen, since the relatively large feature variance of AdderNets. Moreover, we insert more shortcut connections in the neck part and design a new feature fusion architecture for avoiding the sparse features of adder layers. We present extensive ablation studies to explore several design choices of adder detectors. Comparisons with state-of-the-arts are conducted on COCO and PASCAL VOC benchmarks. Specifically, the proposed Adder FCOS achieves a 37.8Adder neural networks (AdderNets) have shown impressive performance on image classification with only addition operations, which are more energy efficient than traditional convolutional neural networks built with multiplications. Compared with classification, there is a strong demand on reducing the energy consumption of modern object detectors via AdderNets for real-world applications such as autonomous driving and face detection. In this paper, we present an empirical study of AdderNets for ob…
Organizer
NeurIPS 2021
Account · 1.9k followers
About NeurIPS 2021
Neural Information Processing Systems (NeurIPS) is a multi-track machine learning and computational neuroscience conference that includes invited talks, demonstrations, symposia and oral and poster presentations of refereed papers. Following the conference, there are workshops which provide a less formal setting.
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
Robust Allocations with Diversity Constraint
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Proportional Participatory Budgeting with Cardinal Utilities
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Learning to Learn Graph Topologies
Watch later
Xingyue Pu, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
It's COMPASlicated: The Messy Relationship between RAI Datasets and Algorithmic Fairness Benchmarks
Watch later
Michelle Bao, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Efficient constrained sampling via the mirror-Langevin algorithm
Watch later
Kwangjun Ahn, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Symmetry Discovery with Deep Learning
Watch later
Krish Desai, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%