For a general class of hidden Markov models that may include time-varying covariates, we illustrate how to compute the observed information matrix, which may be used to obtain standard errors for the parameter estimates and check model identifiability. The proposed method is based on the Oakes’ identity and, as such, it allows for the exact computation of the information matrix on the basis of the output of the expectation-maximization (EM) algorithm for maximum likelihood estimation. In addition to this output, the method requires the first derivative of the posterior probabilities computed by the forward-backward recursions introduced by Baum and Welch. Alternative methods for computing exactly the observed information matrix require, instead, to differentiate twice the forward recursion used to compute the model likelihood, with a greater additional effort with respect to the EM algorithm. The proposed method is illustrated by a series of simulations and an application based on a longitudinal dataset in Health Economics.

Information matrix for hidden Markov models with covariates / F., Bartolucci; Farcomeni, Alessio. - In: STATISTICS AND COMPUTING. - ISSN 1573-1375. - STAMPA. - 25:3(2015), pp. 515-526. [10.1007/s11222-014-9450-8]

Information matrix for hidden Markov models with covariates

FARCOMENI, Alessio
2015

Abstract

For a general class of hidden Markov models that may include time-varying covariates, we illustrate how to compute the observed information matrix, which may be used to obtain standard errors for the parameter estimates and check model identifiability. The proposed method is based on the Oakes’ identity and, as such, it allows for the exact computation of the information matrix on the basis of the output of the expectation-maximization (EM) algorithm for maximum likelihood estimation. In addition to this output, the method requires the first derivative of the posterior probabilities computed by the forward-backward recursions introduced by Baum and Welch. Alternative methods for computing exactly the observed information matrix require, instead, to differentiate twice the forward recursion used to compute the model likelihood, with a greater additional effort with respect to the EM algorithm. The proposed method is illustrated by a series of simulations and an application based on a longitudinal dataset in Health Economics.
2015
em algorithm; forward-backward recursions; oakes’ identity; standard errors
01 Pubblicazione su rivista::01a Articolo in rivista
Information matrix for hidden Markov models with covariates / F., Bartolucci; Farcomeni, Alessio. - In: STATISTICS AND COMPUTING. - ISSN 1573-1375. - STAMPA. - 25:3(2015), pp. 515-526. [10.1007/s11222-014-9450-8]
File allegati a questo prodotto
File Dimensione Formato  
Bartolucci_Information_2014.pdf

accesso aperto

Tipologia: Documento in Post-print (versione successiva alla peer review e accettata per la pubblicazione)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 293.18 kB
Formato Adobe PDF
293.18 kB Adobe PDF
Bartolucci_Information matrix_2015.pdf

solo gestori archivio

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 272.88 kB
Formato Adobe PDF
272.88 kB Adobe PDF   Contatta l'autore

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/536119
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 10
  • ???jsp.display-item.citation.isi??? 11
social impact