Next
Livestream will start soon!
Livestream has already ended.
Presentation has not been recorded yet!
  • title: DyLoRA: Parameter Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low Rank Adaptation
      0:00 / 0:00
      • Report Issue
      • Settings
      • Playlists
      • Bookmarks
      • Subtitles Off
      • Playback rate
      • Quality
      • Settings
      • Debug information
      • Server sl-yoda-v2-stream-007-alpha.b-cdn.net
      • Subtitles size Medium
      • Bookmarks
      • Server
      • sl-yoda-v2-stream-007-alpha.b-cdn.net
      • sl-yoda-v2-stream-007-beta.b-cdn.net
      • 1678031076.rsc.cdn77.org
      • 1932936657.rsc.cdn77.org
      • Subtitles
      • Off
      • English
      • Playback rate
      • Quality
      • Subtitles size
      • Large
      • Medium
      • Small
      • Mode
      • Video Slideshow
      • Audio Slideshow
      • Slideshow
      • Video
      My playlists
        Bookmarks
          00:00:00
            DyLoRA: Parameter Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low Rank Adaptation
            • Settings
            • Sync diff
            • Quality
            • Settings
            • Server
            • Quality
            • Server

            DyLoRA: Parameter Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low Rank Adaptation

            Dec 2, 2022

            Speakers

            MV

            Mojtaba Valipour

            Speaker · 0 followers

            IK

            Ivan Kobyzev

            Speaker · 0 followers

            AG

            Ali Ghodsi

            Speaker · 0 followers

            About

            With the ever-growing size of pre-trained models (PMs), fine-tuning has become more expensive and resource hungry. As a remedy, low-rank adapters (LoRA) keep the main pre-trained weights of the model frozen and just introduce some learnable truncated SVD modules (so called LoRA blocks) to the model. While LoRA blocks are parameter efficient, they suffer from two major problems: first, the size of these blocks is fixed and cannot be modified after training (for example if we need to change the ra…

            Organizer

            N2
            N2

            NeurIPS 2022

            Account · 952 followers

            Like the format? Trust SlidesLive to capture your next event!

            Professional recording and live streaming, delivered globally.

            Sharing

            Recommended Videos

            Presentations on similar topic, category or speaker

            On Margins and Generalisation for Voting Classifiers
            04:48

            On Margins and Generalisation for Voting Classifiers

            Felix Biggs, …

            N2
            N2
            NeurIPS 2022 2 years ago

            Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%

            ConfLab: A Data  Collection Concept, Dataset, and Benchmark for Marichne Analysis of Free-Standing Social Interactions In-the-Wild
            03:51

            ConfLab: A Data Collection Concept, Dataset, and Benchmark for Marichne Analysis of Free-Standing Social Interactions In-the-Wild

            Chirag Raman, …

            N2
            N2
            NeurIPS 2022 2 years ago

            Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%

            Counterfactual Neural Temporal Point Process for Estimating Causal  Influence of Misinformation on Social Media
            05:06

            Counterfactual Neural Temporal Point Process for Estimating Causal Influence of Misinformation on Social Media

            Yizhou Zhang, …

            N2
            N2
            NeurIPS 2022 2 years ago

            Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%

            The Stability-Efficiency Dilemma: Investigating Sequence Length Warmup for Training GPT Models
            01:03

            The Stability-Efficiency Dilemma: Investigating Sequence Length Warmup for Training GPT Models

            Conglong Li, …

            N2
            N2
            NeurIPS 2022 2 years ago

            Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%

            Keypoint-Guided Optimal Transport with Applications in Heterogeneous Domain Adaptation
            05:01

            Keypoint-Guided Optimal Transport with Applications in Heterogeneous Domain Adaptation

            Xiang Gu, …

            N2
            N2
            NeurIPS 2022 2 years ago

            Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%

            SAPA: Similarity-Aware Point Affiliation for Feature Upsampling
            01:04

            SAPA: Similarity-Aware Point Affiliation for Feature Upsampling

            Hao Lu, …

            N2
            N2
            NeurIPS 2022 2 years ago

            Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%

            Interested in talks like this? Follow NeurIPS 2022