A Deep Learning Based Cost Model for Automatic Code Optimization
Apr 4, 2021
Speakers
Riyadh Baghdadi
Speaker · 0 followers
Massinissa Merouani
Speaker · 0 followers
Mohamed-Hicham Leghettas
Speaker · 0 followers
Kamel Abdous
Speaker · 0 followers
Taha Arbaoui
Speaker · 0 followers
Karima Benatchba
Speaker · 0 followers
Saman Amarasinghe
Speaker · 0 followers
About
Enabling compilers to automatically optimize code has been a longstanding goal for the compiler community. Efficiently solving this problem requires using precise cost models. These models predict whether applying a sequence of code transformations reduces the execution time of the program. Building an analytical cost model to do so is hard in modern x86 architectures due to the complexity of the microarchitecture. In this paper, we present a novel deep learning based cost model for automatic code optimization. This model was integrated in a search method and implemented in the Tiramisu compiler to select the best code transformations. The input of the proposed model is a set of simple features representing the unoptimized code and a sequence of code transformations. The model predicts the speedup expected when the code transformations are applied. Unlike previous models, the proposed one works on full programs and does not rely on any heavy feature engineering. The proposed model has only 16% of mean absolute percentage error in predicting speedups on full programs. The proposed model enables Tiramisu to automatically find code transformations that match or are better than state-of-the-art compilers without requiring the same level of heavy feature engineering required by those compilersEnabling compilers to automatically optimize code has been a longstanding goal for the compiler community. Efficiently solving this problem requires using precise cost models. These models predict whether applying a sequence of code transformations reduces the execution time of the program. Building an analytical cost model to do so is hard in modern x86 architectures due to the complexity of the microarchitecture. In this paper, we present a novel deep learning based cost model for automatic co…
Organizer
MLSys 2021
Account · 159 followers
Categories
AI & Data Science
Category · 10.8k presentations
Software & Programming
Category · 1k presentations
About MLSys 2021
The Conference on Machine Learning and Systems targets research at the intersection of machine learning and systems. The conference aims to elicit new connections amongst these fields, including identifying best practices and design principles for learning systems, as well as developing novel learning methods and theory tailored to practical machine learning workflows.
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
Oral: Don't Forget to Sign the Gradients!
Watch later
Omid Aramoon, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Oral: Pipelined Backpropagation at Scale: Training Large Models without Batches
Watch later
Atli Kosson, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Pipelined Backpropagation at Scale: Training Large Models without Batches
Watch later
Atli Kosson, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Main-Memory Acceleration for Bandwidth-Bound Deep Learning Inference
Watch later
Benjamin Cho, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Oral: Towards Scalable Distributed Training of Deep Learning on Public Cloud Clusters
Watch later
Shaohuai Shi, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Oral: ModularNAS: Towards Modularized and Reusable Neural Architecture Search
Watch later
Yunfeng Lin, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%