Ising Model Selection Using l1-Regularized Linear Regression: A Statistical Mechanics Analysis

Dec 6, 2021



We theoretically investigate the typical learning performance of ℓ_1-regularized linear regression (ℓ_1-LinR) for Ising model selection using the replica method from statistical mechanics. For typical random regular (RR) graphs in the paramagnetic phase, we obtain an accurate estimate of the typical sample complexity of ℓ_1-LinR, which demonstrates that ℓ_1-LinR is model selection consistent with M=𝒪(log N) samples, where N is the number of variables of the Ising model. Moreover, we provide a computationally efficient method to accurately predict the non-asymptotic behavior of ℓ_1-LinR for moderate M and N, such as the precision and recall rates. Simulations show a fairly good agreement between the theoretical predictions and experimental results, even for graphs with many loops, which supports our findings. Although this paper focuses on ℓ_1-LinR, our method is readily applicable to precisely investigating the typical learning performance of a wide class of ℓ_1-regularized estimators for Ising model selection such as ℓ_1-regularized logistic regression and interaction screening.


About NeurIPS 2021

Neural Information Processing Systems (NeurIPS) is a multi-track machine learning and computational neuroscience conference that includes invited talks, demonstrations, symposia and oral and poster presentations of refereed papers. Following the conference, there are workshops which provide a less formal setting.

Store presentation

Should this presentation be stored for 1000 years?

How do we store presentations

Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%


Recommended Videos

Presentations on similar topic, category or speaker

Interested in talks like this? Follow NeurIPS 2021