Test-Time for Personalization with a Transformer for Human Pose Estimation
Dec 6, 2021
Speakers
Zonglin Di
Speaker · 0 followers
Nitesh Gundavarapu
Speaker · 0 followers
Xiaolong Wang
Speaker · 0 followers
About
We propose to personalize a human pose estimator given a set of test images of a person without using any manual annotations. While there is a significant advancement in human pose estimation, it is still very challenging for a model to generalize to different unknown environments and unseen persons. Instead of using a fixed model for every test case, we adapt our pose estimator during test time to exploit person-specific information. We first train our model on diverse data with both a supervised and a self-supervised pose estimation objectives jointly. We use a Transformer model to build a transformation between the self-supervised keypoints and the supervised keypoints. During test time, we personalize and adapt our model by fine-tuning with the self-supervised objective. The pose is then improved by transforming the updated self-supervised keypoints. We experiment with multiple datasets and show significant improvements on pose estimations with our self-supervised personalization.We propose to personalize a human pose estimator given a set of test images of a person without using any manual annotations. While there is a significant advancement in human pose estimation, it is still very challenging for a model to generalize to different unknown environments and unseen persons. Instead of using a fixed model for every test case, we adapt our pose estimator during test time to exploit person-specific information. We first train our model on diverse data with both a supervis…
Organizer
NeurIPS 2021
Account · 1.9k followers
About NeurIPS 2021
Neural Information Processing Systems (NeurIPS) is a multi-track machine learning and computational neuroscience conference that includes invited talks, demonstrations, symposia and oral and poster presentations of refereed papers. Following the conference, there are workshops which provide a less formal setting.
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
Neural Algorithmic Reasoners are Implicit Planners
Watch later
Andreea Deac, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Learning Auctions From Partial Observations
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Randomized Automatic Differentiation
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Continual Few-Shot Learning for Named Entity Recognition
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Welcome
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Identity testing for Mallows model
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%