A Dataset-dispersion Perspective on Reconstruction versus Recognition in Single-view 3D Reconstruction Networks
17. listopadu 2021
Řečníci
Yefan Zhou
Řečník · 1 sledující
Yaoqing Yang
Řečník · 0 sledujících
O prezentaci
Neural networks (NN) for single-view 3D reconstruction (SVR) have gained increasing popularity. Recent work points out that for SVR, most cutting-edge NNs rely primarily on recognition rather than shape reconstruction, i.e., they tend to reconstruct shapes by inherently performing classification-based methods. However, it remains unclear when and why NNs prefer recognition to reconstruction and vice versa, and it is also unclear if conventional reconstruction scores can quantify this phenomenon. In this paper, we show that a leading factor in determining recognition versus reconstruction is how clustered the training data is. We introduce dispersion score, a new data-driven metric, to measure if the training data is clustered. Our main claim is that NNs are biased towards recognition when training images are less clustered and when training shapes are more clustered. We verify the main claim and validate the effectiveness of the proposed dispersion score through experiments on both synthetic and benchmark datasets. The proposed dispersion score provides a principled way to analyze reconstruction quality, and it provides novel information in addition to conventional reconstruction scores.Neural networks (NN) for single-view 3D reconstruction (SVR) have gained increasing popularity. Recent work points out that for SVR, most cutting-edge NNs rely primarily on recognition rather than shape reconstruction, i.e., they tend to reconstruct shapes by inherently performing classification-based methods. However, it remains unclear when and why NNs prefer recognition to reconstruction and vice versa, and it is also unclear if conventional reconstruction scores can quantify this phenomenon.…
Organizátor
9th International Conference on 3D Vision
Účet · 28 sledujících
Baví vás formát? Nechte SlidesLive zachytit svou akci!
Profesionální natáčení a streamování po celém světě.
Doporučená videa
Prezentace na podobné téma, kategorii nebo přednášejícího