Bayesian inference for discretely observed continuous time multi-state models

Multi-state models are frequently applied to represent processes evolving through a discrete set of states. Important classes of multi-state models arise when transi- tions between states may depend on the time passed since entry into the current state or on the time elapsed from the start of the process. The former models are called semi-Markov while the latter are known as inhomogeneous Markov models. Infer- ence for both the models presents computational difficulties when the process is only observed at discrete time points with no additional information about the state tran- sitions. In fact, in both the cases, the likelihood function is not available in closed form. To obtain Bayesian inference under these two classes of models we recon- struct the entire unobserved trajectories conditioned on the observed points via a Metropolis-Hastings algorithm. As proposal density we use that given by the nested Markov models whose conditioned trajectories can easily be drawn with the uni- formization technique. The resulting inference is illustrated via simulation studies and the analysis of two benchmark data sets for multi-state models.