Facial Expression Recognition with Adaptive Frame Rate based on Multiple Testing Correction
Jul 24, 2023
Speakers
Andrey W. Savchenko
Speaker · 0 followers
About
In this paper, we consider the problem of the high computational complexity of video-based facial expression recognition. A novel sequential procedure is proposed with an adaptive frame rate selection in a short video fragment to speed up decision-making. We automatically adjust the frame rate and process fewer frames with a low frame rate for more straightforward videos and more frames for complex ones. To determine the frame rate at which an inference is sufficiently reliable, the Benjamini-Hochberg procedure from multiple comparisons theory is employed to control the false discovery rate. The main advantages of our method are an improvement of the trustworthiness of decision-making by maintaining only one hyper-parameter (false acceptance rate) and its applicability with arbitrary neural network models used as facial feature extractors without the need to re-train these models. An experimental study on datasets from ABAW and EmotiW challenges proves the superior performance (1.5-40 times faster) of the proposed approach compared to processing all frames and existing techniques with early exiting and adaptive frame selection.In this paper, we consider the problem of the high computational complexity of video-based facial expression recognition. A novel sequential procedure is proposed with an adaptive frame rate selection in a short video fragment to speed up decision-making. We automatically adjust the frame rate and process fewer frames with a low frame rate for more straightforward videos and more frames for complex ones. To determine the frame rate at which an inference is sufficiently reliable, the Benjamini-Ho…
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
Fairness in Streaming Submodular Maximization over a Matroid Constraint
Watch later
Three Dogmas of Reinforcement Learning
Watch later
A culture of open science, in the era of large AI foundation models
Watch later
Efficient List-Decodable Regression using Batches
Watch later
Ayush Jain, …
Generalized Teacher Forcing for Learning Chaotic Dynamics
Watch later
Florian Hess, …
Same Pre-training Loss, Better Downstream: Implicit Bias Matters for Language Modeling
Watch later
Hong Liu, …