Maximum likelihood estimation of Gaussian mixture models with different class-specific covariance matrices is known to be problematic. This is due to the unboundedness of the likelihood, together with the presence of spurious maximizers. Existing methods to bypass this obstacle are based on the fact that unboundedness is avoided if the eigenvalues of the covariance matrices are bounded away from zero. This can be done imposing some constraints on the covariance matrices, i.e. by incorporating aprioriinformation on the covariance structure of the mixture components. The present work introduces a constrained approach, where the class conditional covariance matrices are shrunk towards a pre-specified target matrix Ψ. Data-driven choices of the matrix Ψ, when aprioriinformation is not available, and the optimal amount of shrinkage are investigated. Then, constraints based on a data-driven Ψ are shown to be equivariant with respect to linear affine transformations, provided that the method used to select the target matrix be also equivariant. The effectiveness of the proposal is evaluated on the basis of a simulation study and an empirical example.

A data driven equivariant approach to constrained gaussian mixture modeling / Rocci, R.; Gattone, S. A.; Di Mari, R.. - In: ADVANCES IN DATA ANALYSIS AND CLASSIFICATION. - ISSN 1862-5347. - 12:2(2018), pp. 235-260. [10.1007/s11634-016-0279-1]

A data driven equivariant approach to constrained gaussian mixture modeling

Rocci R.;
2018

Abstract

Maximum likelihood estimation of Gaussian mixture models with different class-specific covariance matrices is known to be problematic. This is due to the unboundedness of the likelihood, together with the presence of spurious maximizers. Existing methods to bypass this obstacle are based on the fact that unboundedness is avoided if the eigenvalues of the covariance matrices are bounded away from zero. This can be done imposing some constraints on the covariance matrices, i.e. by incorporating aprioriinformation on the covariance structure of the mixture components. The present work introduces a constrained approach, where the class conditional covariance matrices are shrunk towards a pre-specified target matrix Ψ. Data-driven choices of the matrix Ψ, when aprioriinformation is not available, and the optimal amount of shrinkage are investigated. Then, constraints based on a data-driven Ψ are shown to be equivariant with respect to linear affine transformations, provided that the method used to select the target matrix be also equivariant. The effectiveness of the proposal is evaluated on the basis of a simulation study and an empirical example.
2018
equivariant estimators; Gaussian mixture models; model based clustering
01 Pubblicazione su rivista::01a Articolo in rivista
A data driven equivariant approach to constrained gaussian mixture modeling / Rocci, R.; Gattone, S. A.; Di Mari, R.. - In: ADVANCES IN DATA ANALYSIS AND CLASSIFICATION. - ISSN 1862-5347. - 12:2(2018), pp. 235-260. [10.1007/s11634-016-0279-1]
File allegati a questo prodotto
File Dimensione Formato  
Rocci_data-driven-equivarian_2017.pdf

solo gestori archivio

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 768.8 kB
Formato Adobe PDF
768.8 kB Adobe PDF   Contatta l'autore

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1351566
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 10
  • ???jsp.display-item.citation.isi??? 8
social impact