Nonuniform Negative Sampling and Log Odds Correction with Rare Events Data
6. prosince 2021
Řečníci
HaiYing Wang
Speaker · 0 followers
Aonan Zhang
Speaker · 0 followers
Chong Wang
Speaker · 0 followers
O prezentaci
We investigate the issue of parameter estimation with nonuniform negative sampling for imbalanced data. We first prove that, with imbalanced data, the available information about unknown parameters is only tied to the relatively small number of positive instances, which justifies the usage of negative sampling. However, if the negative instances are subsampled to the same level of the positive cases, there is information loss. To maintain more information, we derive the asymptotic distribution of a general inverse probability weighted (IPW) estimator and obtain the optimal sampling probability that minimizes its variance. To further improve the estimation efficiency over the IPW method, we propose a likelihood-based estimator by correcting log odds for the sampled data and prove that the improved estimator has the smallest asymptotic variance among a large class of estimators. It is also more robust to pilot misspecification. We validate our approach on simulated data as well as a real click-through rate dataset with more than 0.3 trillion instances, collected over a period of a month. Both theoretical and empirical results demonstrate the effectiveness of our method.We investigate the issue of parameter estimation with nonuniform negative sampling for imbalanced data. We first prove that, with imbalanced data, the available information about unknown parameters is only tied to the relatively small number of positive instances, which justifies the usage of negative sampling. However, if the negative instances are subsampled to the same level of the positive cases, there is information loss. To maintain more information, we derive the asymptotic distribution o…
Organizátor
NeurIPS 2021
Account · 1.9k followers
O organizátorovi (NeurIPS 2021)
Neural Information Processing Systems (NeurIPS) is a multi-track machine learning and computational neuroscience conference that includes invited talks, demonstrations, symposia and oral and poster presentations of refereed papers. Following the conference, there are workshops which provide a less formal setting.
Baví vás formát? Nechte SlidesLive zachytit svou akci!
Profesionální natáčení a streamování po celém světě.
Sdílení
Doporučená videa
Prezentace na podobné téma, kategorii nebo přednášejícího
Argoverse 2: Next Generation Datasets for Self-driving Perception and Forecasting
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Tensor decomposition of higher-order correlations by nonlinear Hebbian plasticity
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Scalable Causal Domain Adaptation
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Are All Neurons Created Equal? Interpreting and Controlling BERT through Individual Neurons
Watch later
Omer Antverg, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Proxy-Normalizing Activations to Match Batch Normalization while Removing Batch Dependence
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Closing Remarks + Award Presentation
Watch later
Arturo Deza, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%