Active Bipartite Ranking
Dec 10, 2023
Speakers
James Cheshire
Speaker · 0 followers
Stephan Clémençon
Speaker · 0 followers
Vincent Laurent
Speaker · 0 followers
About
In this paper, we develop an active learning framework for the bipartite ranking problem.Motivated by numerous applications, ranging from supervised anomaly detection to credit-scoring through the design of medical diagnosis support systems, and usually formulated as the problem of optimizing (a scalar summary of) the ROC curve, bipartite ranking has been the subject of much attention in the passive context. Various dedicated algorithms have been recently proposed and studied by the machine-learning community. In contrast, active bipartite ranking rule is poorly documented in the literature. Due to its global nature, a strategy for labeling sequentially data points that are difficult to rank w.r.t. to the others is required. This learning task is much more complex than binary classification, for which many active algorithms have been designed. It is the goal of this article to provide a rigorous formulation of such a selective sampling approach. We propose a dedicated algorithm, referred to as active-rank, which aims to minimise the distance between the ROC curve of the ranking function built and the optimal one, w.r.t. the sup norm. We show that, for a fixed confidence level ϵ and probability δ, active-rank is PAC(ϵ,δ). In addition, we provide a problem dependent upper bound on the expected sampling time of active-rank and also demonstrate a problem dependent lower bound on the expected sampling time of any PAC(ϵ,δ) algorithm. Beyond the theoretical analysis carried out, numerical results are presented, providing strong empirical evidence of the performance of the algorithm proposed, which compares favorably with more naive approaches.In this paper, we develop an active learning framework for the bipartite ranking problem.Motivated by numerous applications, ranging from supervised anomaly detection to credit-scoring through the design of medical diagnosis support systems, and usually formulated as the problem of optimizing (a scalar summary of) the ROC curve, bipartite ranking has been the subject of much attention in the passive context. Various dedicated algorithms have been recently proposed and studied by the machine-lear…
Organizer
NeurIPS 2023
Account · 651 followers
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
The Challenges of Landing on Mars
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Multi-Agent Risks from Advanced AI: Multi-Agent Security Workshop
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
RealTime QA: What's the Answer Right Now?
Watch later
Jungo Kasai, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Subclass-Dominant Label Noise: A Counterexample for the Success of Early Stopping
Watch later
Yingbin Bai, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Calibrating Neural Simulation-Based Inference with Differentiable Coverage Probability
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
On the Role of Entanglement and Statistics in Learning
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%