Entropy-Driven Mixed-Precision Quantization for Deep Network Design
Nov 28, 2022
Speakers
Zhenhong Sun
Speaker · 0 followers
Junyan Wang
Speaker · 0 followers
Hesen Chen
Speaker · 0 followers
About
Deploying deep convolutional neural networks on Internet-of-Things (IoT) devices is challenging due to the limited computational resources, such as limited SRAM memory and Flash storage. Previous works either re-design a small network for IoT devices, and then compress the network size by mixed-precision quantization. This two-stage procedure cannot optimize the architecture and the corresponding quantization jointly, leading to sub-optimal tiny deep models. In this work, we propose a one-stage solution that optimizes both jointly and automatically. The key idea of our approach is to cast the joint architecture design and quantization as an Entropy Maximization process. Particularly, our algorithm automatically designs a tiny deep model such that: 1) its representation capacity measured by entropy is maximized under the given computational budget; 2) Each layer is assigned with a proper quantization precision; 3) The overall design loop can be done on CPU, and no GPU is required. More impressively, our method can directly search high-expressiveness architecture for IoT devices within less than half a CPU hour. Extensive experiments on three widely adopted benchmarks, ImageNet, VWW and WIDER FACE, demonstrate that our method can achieve the state-of-the-art performance in the tiny deep model regime.Deploying deep convolutional neural networks on Internet-of-Things (IoT) devices is challenging due to the limited computational resources, such as limited SRAM memory and Flash storage. Previous works either re-design a small network for IoT devices, and then compress the network size by mixed-precision quantization. This two-stage procedure cannot optimize the architecture and the corresponding quantization jointly, leading to sub-optimal tiny deep models. In this work, we propose a one-stage…
Organizer
NeurIPS 2022
Account · 952 followers
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
Opening Remarks
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
When to Update Your Model: Constrained Model-based Reinforcement Learning
Watch later
Tianying Ji, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
On Global Convergence of ResNets: From finite to infinite width using linear parameterization
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Prune and Distill: Similar reformatting of image information along rat visual cortex and deep neural networks
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Provably Efficient Offline Multi-agent Reinforcement Learning via Strategy-wise Bonus
Watch later
Qiwen Cui, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Featured Papers Panels 2A
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%