An open problem of Markov switching models is identifying the number of states, gener-ally fixed a priori; it is impossible to apply classical tests due to the issue of the nuisanceparameters present only under the alternative hypothesis. In this work, we show, by MonteCarlo simulations, that fuzzy clustering is able to reproduce the parametric state inferencederived from the Hamilton filter and that the typical indices used in clustering to determinethe number of groups can be used to identify the number of states in this framework. Theprocedure is very simple to apply, considering that it is performed independently of the datagenerating process and that the indicators we use are available in most statistical packages.Furthermore, the proposed approach appears to be sufficiently robust to perturbations in thedata generating processes. A final application of real data completes the analysis.

On using fuzzy clustering for detecting the number of states in Markov switching models / Otranto, Edoardo; Scaffidi Domianello, Luca. - In: ANNALS OF OPERATIONS RESEARCH. - ISSN 0254-5330. - 349:(2025), pp. 1855-1890. [10.1007/s10479-025-06585-w]

On using fuzzy clustering for detecting the number of states in Markov switching models

Edoardo Otranto
;
2025

Abstract

An open problem of Markov switching models is identifying the number of states, gener-ally fixed a priori; it is impossible to apply classical tests due to the issue of the nuisanceparameters present only under the alternative hypothesis. In this work, we show, by MonteCarlo simulations, that fuzzy clustering is able to reproduce the parametric state inferencederived from the Hamilton filter and that the typical indices used in clustering to determinethe number of groups can be used to identify the number of states in this framework. Theprocedure is very simple to apply, considering that it is performed independently of the datagenerating process and that the indicators we use are available in most statistical packages.Furthermore, the proposed approach appears to be sufficiently robust to perturbations in thedata generating processes. A final application of real data completes the analysis.
2025
Nuisance parameters; Groups identification; Monte Carlo simulations; Markov chains
01 Pubblicazione su rivista::01a Articolo in rivista
On using fuzzy clustering for detecting the number of states in Markov switching models / Otranto, Edoardo; Scaffidi Domianello, Luca. - In: ANNALS OF OPERATIONS RESEARCH. - ISSN 0254-5330. - 349:(2025), pp. 1855-1890. [10.1007/s10479-025-06585-w]
File allegati a questo prodotto
File Dimensione Formato  
Otranto-Scaffidi_3.pdf

solo gestori archivio

Tipologia: Documento in Post-print (versione successiva alla peer review e accettata per la pubblicazione)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 1.19 MB
Formato Adobe PDF
1.19 MB Adobe PDF   Contatta l'autore

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1737765
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact