We introduce the first completely unsupervised correspondence learning approach for deformable 3D shapes. Key to our model is the understanding that natural deformations (such as changes in pose) approximately preserve the metric structure of the surface, yielding a natural criterion to drive the learning process toward distortion-minimizing predictions. On this basis, we overcome the need for annotated data and replace it by a purely geometric criterion. The resulting learning model is class-agnostic, and is able to leverage any type of deformable geometric data for the training phase. In contrast to existing supervised approaches which specialize on the class seen at training time, we demonstrate stronger generalization as well as applicability to a variety of challenging settings. We showcase our method on a wide selection of correspondence benchmarks, where we outperform other methods in terms of accuracy, generalization, and efficiency.

Unsupervised learning of dense shape correspondence / Halimi, O.; Litany, O.; Rodolà, E.; Bronstein, A. M.; Kimmel, and R.. - 2019-June:(2019), pp. 4365-4374. (Intervento presentato al convegno Proc. Int’l Conference on Computer Vision and Pattern Recognition (CVPR) tenutosi a Long Beach; United States) [10.1109/CVPR.2019.00450].

Unsupervised learning of dense shape correspondence

E. Rodolà;
2019

Abstract

We introduce the first completely unsupervised correspondence learning approach for deformable 3D shapes. Key to our model is the understanding that natural deformations (such as changes in pose) approximately preserve the metric structure of the surface, yielding a natural criterion to drive the learning process toward distortion-minimizing predictions. On this basis, we overcome the need for annotated data and replace it by a purely geometric criterion. The resulting learning model is class-agnostic, and is able to leverage any type of deformable geometric data for the training phase. In contrast to existing supervised approaches which specialize on the class seen at training time, we demonstrate stronger generalization as well as applicability to a variety of challenging settings. We showcase our method on a wide selection of correspondence benchmarks, where we outperform other methods in terms of accuracy, generalization, and efficiency.
2019
Proc. Int’l Conference on Computer Vision and Pattern Recognition (CVPR)
unsupervised learning approach; deformable 3D shapes
04 Pubblicazione in atti di convegno::04b Atto di convegno in volume
Unsupervised learning of dense shape correspondence / Halimi, O.; Litany, O.; Rodolà, E.; Bronstein, A. M.; Kimmel, and R.. - 2019-June:(2019), pp. 4365-4374. (Intervento presentato al convegno Proc. Int’l Conference on Computer Vision and Pattern Recognition (CVPR) tenutosi a Long Beach; United States) [10.1109/CVPR.2019.00450].
File allegati a questo prodotto
File Dimensione Formato  
Halimi_Unsupervised_2019.pdf

solo gestori archivio

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 1.58 MB
Formato Adobe PDF
1.58 MB Adobe PDF   Contatta l'autore

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1360138
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 111
  • ???jsp.display-item.citation.isi??? 71
social impact