Nov 28, 2022
Speaker · 0 followers
Speaker · 0 followers
Speaker · 0 followers
We consider the batch active learning problem, where only a subset of the training data is labeled, and the goal is to query a batch of unlabeled samples to be labeled so as to maximally improve model performance. We formulate the learning problem using constrained optimization, where each constraint bounds the performance of the model on labeled samples. Considering a primal-dual approach, we optimize the primal variables, corresponding to the model parameters, as well as the dual variables, corresponding to the constraints. As each dual variable indicates how significantly the perturbation of the respective constraint affects the optimal value of the objective function, we use it as a proxy of the informativeness of the corresponding training sample. Our approach, which we refer to as Active Learning via Lagrangian dualitY, or ALLY, leverages this fact to select a diverse set of unlabeled samples with the highest estimated dual variables as our query set. We demonstrate the benefits of our approach in a variety of classification and regression tasks and also discuss its limitations depending on the capacity of the model used. We also show that ALLY can be used in a generative mode to create novel maximally-informative samples.We consider the batch active learning problem, where only a subset of the training data is labeled, and the goal is to query a batch of unlabeled samples to be labeled so as to maximally improve model performance. We formulate the learning problem using constrained optimization, where each constraint bounds the performance of the model on labeled samples. Considering a primal-dual approach, we optimize the primal variables, corresponding to the model parameters, as well as the dual variables, co…
Account · 953 followers
Professional recording and live streaming, delivered globally.
Presentations on similar topic, category or speaker
Wei Lu, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Total of 1 viewers voted for saving the presentation to eternal vault which is 0.1%
Evan Becker, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Khai Nguyen, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%