Next
Livestream will start soon!
Livestream has already ended.
Presentation has not been recorded yet!
  • title: DyLoRA: Parameter Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low Rank Adaptation
      0:00 / 0:00
      • Report Issue
      • Settings
      • Playlists
      • Bookmarks
      • Subtitles Off
      • Playback rate
      • Quality
      • Settings
      • Debug information
      • Server sl-yoda-v2-stream-007-alpha.b-cdn.net
      • Subtitles size Medium
      • Bookmarks
      • Server
      • sl-yoda-v2-stream-007-alpha.b-cdn.net
      • sl-yoda-v2-stream-007-beta.b-cdn.net
      • 1678031076.rsc.cdn77.org
      • 1932936657.rsc.cdn77.org
      • Subtitles
      • Off
      • English
      • Playback rate
      • Quality
      • Subtitles size
      • Large
      • Medium
      • Small
      • Mode
      • Video Slideshow
      • Audio Slideshow
      • Slideshow
      • Video
      My playlists
        Bookmarks
          00:00:00
            DyLoRA: Parameter Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low Rank Adaptation
            • Settings
            • Sync diff
            • Quality
            • Settings
            • Server
            • Quality
            • Server

            DyLoRA: Parameter Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low Rank Adaptation

            Dec 2, 2022

            Speakers

            MV

            Mojtaba Valipour

            Speaker · 0 followers

            IK

            Ivan Kobyzev

            Speaker · 0 followers

            AG

            Ali Ghodsi

            Speaker · 0 followers

            About

            With the ever-growing size of pre-trained models (PMs), fine-tuning has become more expensive and resource hungry. As a remedy, low-rank adapters (LoRA) keep the main pre-trained weights of the model frozen and just introduce some learnable truncated SVD modules (so called LoRA blocks) to the model. While LoRA blocks are parameter efficient, they suffer from two major problems: first, the size of these blocks is fixed and cannot be modified after training (for example if we need to change the ra…

            Organizer

            N2
            N2

            NeurIPS 2022

            Account · 952 followers

            Like the format? Trust SlidesLive to capture your next event!

            Professional recording and live streaming, delivered globally.

            Sharing

            Recommended Videos

            Presentations on similar topic, category or speaker

            Multi-objective Tree-structured Parzen Estimator Meets Meta-learning
            04:46

            Multi-objective Tree-structured Parzen Estimator Meets Meta-learning

            Shuhei Watanabe, …

            N2
            N2
            NeurIPS 2022 2 years ago

            Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%

            Provably Adversarially Robust Detection of Out-of-Distribution Data (Almost) for Free
            04:56

            Provably Adversarially Robust Detection of Out-of-Distribution Data (Almost) for Free

            Alexander Meinke, …

            N2
            N2
            NeurIPS 2022 2 years ago

            Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%

            Training Scale-Invariant Neural Networks on the Sphere Can Happen in Three Regimes
            04:53

            Training Scale-Invariant Neural Networks on the Sphere Can Happen in Three Regimes

            Maxim Kodryan, …

            N2
            N2
            NeurIPS 2022 2 years ago

            Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%

            Calibration of Large Neural Weather Models
            08:57

            Calibration of Large Neural Weather Models

            Andre Graubner, …

            N2
            N2
            NeurIPS 2022 2 years ago

            Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%

            One Layer is All You Need
            04:25

            One Layer is All You Need

            Yue Bai, …

            N2
            N2
            NeurIPS 2022 2 years ago

            Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%

            Posted Pricing and Dynamic Prior-independent Mechanisms with Value Maximizers
            04:43

            Posted Pricing and Dynamic Prior-independent Mechanisms with Value Maximizers

            Yuan Deng, …

            N2
            N2
            NeurIPS 2022 2 years ago

            Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%

            Interested in talks like this? Follow NeurIPS 2022