Linear Convergence of Gradient Methods for Estimating Structured Transition Matrices in High-dimensional Vector Autoregressive Models
Dec 6, 2021
Speakers
About
In this paper, we present non-asymptotic optimization guarantees of gradient descent methods for estimating structured transition matrices in high-dimensional vector autoregressive (VAR) models. We adopt the projected gradient descent (PGD) for single-structured transition matrices and the alternating projected gradient descent (AltPGD) for superposition-structured ones. Our analysis demonstrates that both gradient algorithms converge linearly to the statistical error even though the strong convexity of the objective function is absent under the high-dimensional settings. Moreover our result is sharp (up to a constant factor) in the sense of matching the phase transition theory of the corresponding model with independent samples. To the best of our knowledge, this analysis constitutes first non-asymptotic optimization guarantees of the linear rate for regularized estimation in high-dimensional VAR models. Numerical results are provided to support our theoretical analysis.In this paper, we present non-asymptotic optimization guarantees of gradient descent methods for estimating structured transition matrices in high-dimensional vector autoregressive (VAR) models. We adopt the projected gradient descent (PGD) for single-structured transition matrices and the alternating projected gradient descent (AltPGD) for superposition-structured ones. Our analysis demonstrates that both gradient algorithms converge linearly to the statistical error even though the strong conv…
Organizer
NeurIPS 2021
Account · 1.9k followers
About NeurIPS 2021
Neural Information Processing Systems (NeurIPS) is a multi-track machine learning and computational neuroscience conference that includes invited talks, demonstrations, symposia and oral and poster presentations of refereed papers. Following the conference, there are workshops which provide a less formal setting.
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
Real Robot Challenge: Learning Dexterous Manipulation on Real Robots in the Cloud
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
ABY2.0: New Efficient Primitives for STPC with Applications to Privacy in Machine Learning (Extended Abstract)
Watch later
Arpita Patra, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
AI for Augmenting Human Creativity
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Directed Spectral Measures Improve Latent Network Models Of Neural Populations
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Multi-Agent Reinforcement Learning in Stochastic Networked Systems
Watch later
Yiheng Lin, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Bayesian Calibration of imperfect computer models using Physics-informed priors
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%