Ising Model Selection Using l1-Regularized Linear Regression: A Statistical Mechanics Analysis

Dez 6, 2021

Sprecher:innen

Über

We theoretically investigate the typical learning performance of ℓ_1-regularized linear regression (ℓ_1-LinR) for Ising model selection using the replica method from statistical mechanics. For typical random regular (RR) graphs in the paramagnetic phase, we obtain an accurate estimate of the typical sample complexity of ℓ_1-LinR, which demonstrates that ℓ_1-LinR is model selection consistent with M=𝒪(log N) samples, where N is the number of variables of the Ising model. Moreover, we provide a computationally efficient method to accurately predict the non-asymptotic behavior of ℓ_1-LinR for moderate M and N, such as the precision and recall rates. Simulations show a fairly good agreement between the theoretical predictions and experimental results, even for graphs with many loops, which supports our findings. Although this paper focuses on ℓ_1-LinR, our method is readily applicable to precisely investigating the typical learning performance of a wide class of ℓ_1-regularized estimators for Ising model selection such as ℓ_1-regularized logistic regression and interaction screening.

Organisator

Über NeurIPS 2021

Neural Information Processing Systems (NeurIPS) is a multi-track machine learning and computational neuroscience conference that includes invited talks, demonstrations, symposia and oral and poster presentations of refereed papers. Following the conference, there are workshops which provide a less formal setting.

Präsentation speichern

Soll diese Präsentation für 1000 Jahre gespeichert werden?

Wie speichern wir Präsentationen?

Ewigspeicher-Fortschrittswert: 0 = 0.0%

Freigeben

Empfohlene Videos

Präsentationen, deren Thema, Kategorie oder Sprecher:in ähnlich sind

Interessiert an Vorträgen wie diesem? NeurIPS 2021 folgen