Coarse-to-fine Animal Pose and Shape Estimation
6. prosince 2021
Řečníci
Gim Hee Lee
Řečník · 0 sledujících
O prezentaci
Most existing animal pose and shape estimation approaches reconstruct animal meshes with a parametric SMAL model. This is because the low-dimensional pose and shape parameters of the SMAL model makes it easier for deep networks to learn the high-dimensional animal meshes. However, the SMAL model is obtained from scans of toy animals with limited pose and shape variations, and thus may not be able to represent highly varying real animals well. This can result in ill-fittings of the estimated mesh to the 2D evidences, e.g. 2D keypoints or silhouettes. To mitigate this problem, we propose a coarse-to-fine approach to reconstruct 3D animal mesh from a single image. The coarse estimation stage first estimates the pose, shape and translation parameters of the SMAL model. The estimated meshes are then used as a starting point by a graph convolutional network (GCN) to predict a per-vertex deformation in the refinement stage. This combination of SMAL-based and vertex-based representations benefits from both parametric and non-parametric representations. We design our mesh refinement GCN (MRGCN) as an encoder-decoder structure with hierarchical feature representation to overcome the limited receptive field of traditional GCNs.Moreover, we observe that the global image feature used by all existing animal mesh reconstruction works is unable to capture detailed shape information for mesh refinement. We thus introduce a local feature extractor to retrieve a vertex-level feature and use it together with the global feature as the input of the MRGCN. We test our approach on the StanfordExtra dataset and achieve state-of-the-art results. Furthermore, we test the generalization capacity of our approach on the Animal Pose and BADJA datasets. Our code will be made available for research purpose upon acceptance of this paper.Most existing animal pose and shape estimation approaches reconstruct animal meshes with a parametric SMAL model. This is because the low-dimensional pose and shape parameters of the SMAL model makes it easier for deep networks to learn the high-dimensional animal meshes. However, the SMAL model is obtained from scans of toy animals with limited pose and shape variations, and thus may not be able to represent highly varying real animals well. This can result in ill-fittings of the estimated mesh…
Organizátor
NeurIPS 2021
Účet · 1,9k sledujících
O organizátorovi (NeurIPS 2021)
Neural Information Processing Systems (NeurIPS) is a multi-track machine learning and computational neuroscience conference that includes invited talks, demonstrations, symposia and oral and poster presentations of refereed papers. Following the conference, there are workshops which provide a less formal setting.
Baví vás formát? Nechte SlidesLive zachytit svou akci!
Profesionální natáčení a streamování po celém světě.
Sdílení
Doporučená videa
Prezentace na podobné téma, kategorii nebo přednášejícího
Dueling Bandits with Adversarial Sleeping
Zhlédnout později
Pro uložení prezentace do věčného trezoru hlasovalo 0 diváků, což je 0.0 %
Opening remarks
Zhlédnout později
Pro uložení prezentace do věčného trezoru hlasovalo 0 diváků, což je 0.0 %
A Law of Iterated Logarithm for Multi-Agent Reinforcement Learning
Zhlédnout později
Gugan Thoppe, …
Pro uložení prezentace do věčného trezoru hlasovalo 0 diváků, což je 0.0 %
Symmetries
Zhlédnout později
Pro uložení prezentace do věčného trezoru hlasovalo 0 diváků, což je 0.0 %
MAPLE: Microprocessor A Priori for Latency Estimation
Zhlédnout později
Saad Abbasi, …
Pro uložení prezentace do věčného trezoru hlasovalo 0 diváků, což je 0.0 %
The Platform Design Problem
Zhlédnout později
Pro uložení prezentace do věčného trezoru hlasovalo 0 diváků, což je 0.0 %