Ising Model Selection Using l1-Regularized Linear Regression: A Statistical Mechanics Analysis
Dec 6, 2021
Speakers
Xiangming Meng
Speaker · 0 followers
Tomoyuki Obuchi
Speaker · 0 followers
Yoshiyuki Kabashima
Speaker · 0 followers
About
We theoretically investigate the typical learning performance of ℓ_1-regularized linear regression (ℓ_1-LinR) for Ising model selection using the replica method from statistical mechanics. For typical random regular (RR) graphs in the paramagnetic phase, we obtain an accurate estimate of the typical sample complexity of ℓ_1-LinR, which demonstrates that ℓ_1-LinR is model selection consistent with M=𝒪(log N) samples, where N is the number of variables of the Ising model. Moreover, we provide a computationally efficient method to accurately predict the non-asymptotic behavior of ℓ_1-LinR for moderate M and N, such as the precision and recall rates. Simulations show a fairly good agreement between the theoretical predictions and experimental results, even for graphs with many loops, which supports our findings. Although this paper focuses on ℓ_1-LinR, our method is readily applicable to precisely investigating the typical learning performance of a wide class of ℓ_1-regularized estimators for Ising model selection such as ℓ_1-regularized logistic regression and interaction screening.We theoretically investigate the typical learning performance of ℓ_1-regularized linear regression (ℓ_1-LinR) for Ising model selection using the replica method from statistical mechanics. For typical random regular (RR) graphs in the paramagnetic phase, we obtain an accurate estimate of the typical sample complexity of ℓ_1-LinR, which demonstrates that ℓ_1-LinR is model selection consistent with M=𝒪(log N) samples, where N is the number of variables of the Ising model. Moreover, we provide a c…
Organizer
NeurIPS 2021
Account · 1.9k followers
About NeurIPS 2021
Neural Information Processing Systems (NeurIPS) is a multi-track machine learning and computational neuroscience conference that includes invited talks, demonstrations, symposia and oral and poster presentations of refereed papers. Following the conference, there are workshops which provide a less formal setting.
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
Contributed Talks in Session 2
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
DOCTOR: A Simple Method for Detecting Misclassification Errors
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
HSVA: Hierarchical Semantic-Visual Adaptation for Zero-Shot Learning
Watch later
Shiming Chen, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
End-To-End Online sPHENIX Trigger Detection Pipeline
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Being the Fire: A CNN-Based Reinforcement Learning Method to Learn How Fires Behave Beyond the Limits of Physics-Based Empirical Models
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Spotlight Talk 1
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%